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Volume II— Appendix 



FOREWORD 



Volume II— Appendix of The Report of the Science Curriculum Review 
Team on Pre-CoUege Science Curriculum Activities of the National Science 
Foundation includes many of the basic documents used to arrive at the fin- 
dings and recommendations contained in Volume I. These are supported in 
many instances with substantial additional documentation too voluminous to 
publish. 

Included as Appendix 1 are the letters and memorandum establishing thp 
purpose of and charge to the Review Team. 

. -i^ppendix 2 contains an historical overview of program growth and the 
factors that impacted on NSF policies and programs, including a description 
of Congressional interest. National Science Board involvement, and the . 
current approach to pre-cbllege science education reflecting the influence of 
the Executive Office of the President. 

Appendix 3 provides an analysis and background of distributio n polic y 
and financial arrangements. It also includes a summary "of pversighj.- 
procedures. • ' . 

Appendix 4 contains the five summary case studies developed as an aid in 
siaff and Review Team development of tlje observations and policy issues 
presented in Volume I. Synopses of these dases can be found in Section II of 
Volume I. 

Appendix 5 is the summary audit p?epared by the NSF Audit Office of the 
five, projects selected for case study. 

Appendix 6 contains two commissioned papers which present some other, 
views on support of curriculum development and implementation. 

Appendix 7 is a table summarizing project funding, developer, publisher, 
and royalty arrangements. 
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Charge to 
the Review Team 

Letter from the Director. NSF to Congressman Olin Teague. 
March 17, 1975.-— r- 

Letter from the Director, NSF to Congressman Olin Teague, April 
1, 1975. . 

Letter from |he Director, NSF to Dr. Joel' A. Snow, Director. Of- 
fice of Plannijig and Resources Management, April 2, 1975. 

Memo from /the Director, NSF to CJiaiwrran, Science Curriculum 
Review Team, April 17. 1975. . 



NATIQNALT SCIENCE FOUNDATION 

WASHINGTON. D.C. 20550 

* 

■■ -Hi. ' ■■• . • ■ ■ • 

; * March 17, 1975 

OFFICE OF THE 

DIRECTOR i 

'Honorabre"criin E. league 
Chairman 

Committee on Science and Technology 
House of Representa.t.ives 
Washing on,-D. C. 20515 

Dear Chairman league: 

I have now had a chance to talk about MACOS with a number of 
members arid^ staff of the Committee on Science and Technology and 
especially of the Subcommittee on Science, now that all have had 
a full opportunity to see all of the MCOS materia^.— films, teacher 
manuals, student pamjiplets, etc. The top leaders of the NSF staff, 
including the Director, Assistant Directors, and members of both 
the Executive and Management Councils and others have also examined 
the material. 

Because of the concerns expressed on all sides of several issues, I 
have' decided that, regardless of what action is taken by Congress, 
^ no further 1975 funds will be obligated for MACOS, and no 1976 
funds, if authorized and appropriated, will be obligated either 
for MACOS or any other precollege science course development and 

implementation until we have conducted a thorough review of the 

NSF effort in these areas and reported to the National Science 
Board and Congress with recommendations. I will assign a top- 
level group of staff from the foundation with some members outside 
the Education Directorate, together with some carefully chosen 
outsiders to make this report to me. 

I have al^o considered the possibility of recalling the ^lACOS 
portion of the implementation grants made in January and announced 
publicly on January 15, '1975, before any. of the current discussion 

"oSmCOS Ws brought to my attention; — Personal~lyv-I~tio not— - 

believe that this can be done without opening the door to counter 
protests and claims of censorship. I will discuss this with the 
National Science Board during their meeting on March 20 and 21 
after which time I will determine whether or not this can or 
should be done. 
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. As backgr^^^ to. the following examination, of. MACOS issues, I would 
like to point put that there should be no surprise on anyone' s* part 
that NSF is in this kind of precollege (elementary and secondary 
school) science course development and implementation. MACOS is 
one of 38 courses developed since 1956 in. physics, mathematics, 
chemistry, biology , anthropology , geography , sociology , , engineering , 
general science, political science and others. Some of these are 
greatly successful and-very well known in and out of education 
circles. Others are. only in their early implementation stages. 
Furthermore, there are an additional 12 courses . still under 
development, in biology, mathematics, interdisciplinary science, 
psychology, algebra and other fields, which have been started in 
the period from 1968 to 1974. ' 

The Congress, responding to recommendations from different segments 
of the educational and scientific communities, has long encouraged 
us in this kind of science education venture. 

The controversy over MACOS has several different focal points which 
I believe can be summarized by the following questions: 

Is the scientific material truthful and factual? 

Is it a proper collection of material for fifth and sixth 
graders? - 

I'Tho should decide that question? 

Do teachers carry the class discussion ^ar afield from the 
content of the recommended material? 

Has the NSF followed proper contracting procedures in the 
development and implementation of MACOS? 

Does the NSF go too far in implementation of precollege 
science education courses? 

What evaluation procedures are proper for MACOS and similar 
court»es? 

Has NSF had a broad enough examination of the total coverage 
of its precollege science course- developments? ■ - - - 

I would like to speak briiefly to each of these questions, although 
clearly each deserves a very long treatmeat. 

1.. Is the scientific material truthful and factual? . 

From my examination of the material and from conversations with 
experts in the education and anthropology field, I believe that there 



1. 

2. 

3. 
4. 

5. 

6. 

7. 

8. 
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is general agreement that the scientific material on which the course 
is based' is accurate. Any action Congress or NSF or anyone else 
might take based on this point would produce a large flow of positive 
opinion about the accuracy of the course content of MACOS. 

2. Is it a proper collection of marterial for fifth and sixth 
graders? 

There is. a sharp difference of opinion of this point. Some 
believe that parts of the material are too gory. Hardly anyone 
believes that there are not gory parts in some films, but the 
difference of opinion comes in attitude about when such material 
should be exposed to students. Some believe that sex is over done; 
others are on the opposite side. Some believe that the material 
in toto reinforces strong family traditions; others feel just the 
opposite. There are similar disagreements on other topics such 
as crime, communal living, etc., which generate strong emotions. 
In th±G area, value judgments are sharply held. 

■ 

3. Who should decide that, question? 

We cannot say categorically that all fifth and sixth graders 
should see this material or that none 'Should. There clearly are 
strongly held opinions amongst scientists, educators and many others 
that this is a proper and ver^ desirable course for that age group, 
there is clearly opposition to this opinion. 

An important practical matter as far as this material is con- 
cerned is that this course is widely available. The decisions as 
to whether or not it should be taught or whether it should be / 
elective or required are now out of the, hands of the NSF and the 
Congress. These decisions are being made by local school systems, 
and I believe that this is the proper decision point. 

In treating questions 2 and 3, I have considered the suggestion that 
the NSF contact every school board to inform them that the course 
has generated 'controversy and that' we urge each school board to 

have a very thorough examination by public of ficials, teach ers , 

parents and all others of the contraun±ty7^o-rk-inX~toge1^ before 
deciding upon use. I will discuss this possible action with the 
National Science Board on March 20 and 21. Clearly, there are 
pro^-and -Gontras - to such-~ac tion.* : . 

4. Do teachers carry the class discussions far afield from the 
content of the recommended material? 

We believe that this is entirely a matter for local judgment. 

5. Has the NSF followed proper contracting procedures in the 
development and implementation of MACOS? 

What I have learned to date on this point indicates a positive 
answer. We will of course continue to pursue our investigations 



of this point. 

6. • Does the NSF go too far in implementation of precollege 

science education courses? 

We have responsibility to respond to positive needs for help in 
implementation.- However, as mentioned earlier our implementation 
will be reexamined by the National Science Foundation. _ . 

i ■ 

7. \^at evaluation procedures are proper for MACOS and similar 
courses? 

We have had evaluation during the course development and 
implementation. Now we are proceeding more to independent evaluators 
of courses after they have gone into school systems. We at NSF 
will be doing much more work along this line in the future. 

8. Has NSF had a broad enough examination of the total coverage 
of its precollege science course developments? 

■ . * ' ■ " / 

This is another question which must be discussed within the 

Foundat ion with r ecommenda t ions made to the Na t ional Science^ Board 

and other interested parties concerning the future of this activity. 

/ 

I hope that further attention by the National Science Foundation . 
staff and the National Science Board will bring this broad activity 
under oversight which is satisfactory to the Congress. 

Sincerely yours. 



H. Guyford Stever 
Director 



Copy to: Congressman James W. Symington 
Congressman Charles A. Mosher 
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NATIONAL SCIENCE FOUNDATION 
WASHINGTON. DC. 20550 



ERIC 



•f^ J^ ' ' \ . ! 

^4- April 1, 1975 

OFFICE OF THE 
DIRECTOR 



Honorable 01 in E. league 
Chairman 

Committee on Science and Technology 
House of Representatives 

Washington, p. C. 20515 \ 
Dear Chairman league: 

At the National Science Board meeting on March 20 and 21, I had the 
opportunity to brief the Board on the recent events related to the 
curriculum project "Man: A Course Study" (MACOS) and the current 
discussions surrounding it and the general question of course 
implementation* We carefullV reviewed m detail the points made 
in my previous letters to you and Mr. Conlan on the subject. As 
I indicated in my letter of March 17, I asked the Board to consider 
several questions that were unresolved. 

In this discussion, the rolel of the NSF in science course development 
was reexamined. The Board Continues to believe that the NSF role is 
that of selecting science course%development projects which are 
believed to have significant promise of strengthening science 
education. In that selection NSF must ensure that: 

o .the proposed subject m.atter fits within reasonable limits or 
norms with respect to educational value; 

o the scientific content is accurate;. 

o the course developers are responsible and competent persons; 

o the institutional and contractual arrangements are sound. 

The Board cbncurs with me that it is not the perogative of the NSF 
to dictate what material should be taught in primary and 

secondary schools (or in the colleges and universities. That is for 
the appropriate local author it es to decide. That has always been 
our position. 

In implementation of courses, the Board agrees that NSF has a 
responsibility to help science teachers at all levels become 
acquainted with a variety o4-m^terial. Our implementation efforts 
should not be solely concerned with NSF-funded course developments 
but should include a variety of good science courses wherever 
developed. \ 

10 ' 1 



As has been our policy, the Board reaffirms that no material may be 
marketed with any NSF endoresement and that printed material should 
contain an expffess disclaimer. 



The' National Science Board unanimously approved the action for a study 
by the NSF, as I outlined in my letter to you. My suspension of further 
.obligations of FY 1975 funds for MACOS implementation and of all 
precollege development and implementation grants in FY 1976 will not 
seriously affect this field provided that the study is completed 
by June as scheduled and, of course , provided the decision resulting 
from the study is to coi\tinue the program. 

The Beard, after consideration of all facets of the question, has 
agreed unanimously with my recommendation not to rescind the 
implementation grants that were awarded in January. These grants 
were made in good faithl, they cover a variety of courses, not just 
NSF-funded course devel(5pments , and only.ja small portion of these 
have any MACOS content. Their continuation will in no way bias ; 
the longer term examination of the NSF course implementation 
policies and procedures.^ At my request, the Board also considered 
the possibility of sending a precautionary note to every school 
district in the country. \ This was rejected as being both an 
unnecessary and a gratuitous intrusion into the local decision- 
making pi^ocess. \ i ^ 

The Pre-college Education Sciencfe Program has recently been 
reviewed by the Board. Nonetheless, the Board in endorsing the plan 
for the internal Foundation, study, will participate in a deeper 
review through the appointment of a Board Member to work with the 
top-level NSF staff assigned by me to this review. j Following 
this Board consideration,' I will report to your Committee. 

In my NSF review I plan to have investigated the pre-college : ~ 
curriculum development activities .in a broad sense, including 
MACOS particularly and also the program more generally. To do 
this, scmb procedural questions will be studied; for example, the 
distribution rights and royalty arrangements. Injaddition to a 
general survey of all of the curricula that have been developed, 
I shall have the review team make a detailed stud}^ of several cases 
as well as MACOS to see what they illustrate about the procedures 
that NSF has used in the support of curriculum development. The 
review will examine the following: 



(A) Curriculum Development Program 

(1) History ^ 

(2) Case Studies 
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a. Chemistry curriculum, 1959-1969 

b. Science Curriculum -Improvement Study, 1962-Present 
c* Man: A Course of Study, 1963-1970 

d. Comparing Political Experiences, 1972-Present 

e. '^ Individualized Science Instructional System, 1972-Present 

(B) . NSF Distribution Policy and -Royalty Arrangements 

• (1) History 

((2) National Science Board Policy (1969) 

(C) Curriculum Implementation Procedures / - 

* ■ • » ^ 

(1) History 

(2) Research Studies Regarding Implementation 

(3) Current Practices 

(D) Evaluation Procedures for Establishing Content and Utilization 



\ (E) Practices and Procedures in Science Curriculum Developed by 
^ Other Organizations 

• .\ ■ ^ ' . ^ 

' \ (F) Recommendations 

■ • !■ ■ ' ■ ■ ^ ■ . u 

Although we are still assembling the review team, our intent is that 

it will be comprised of at least the following: 

Dr» Robert E. Hughes, Assistant Director for National and 
International Programs (Chairman of the Review Team) 

Dr» Grover E» Murray, Member, National Science Board, and 

President, Texas Tech University and Texas Tech University 
School of Medicine 

Dr. L. Donald Shields, Member, National Science Board, and . 
President, California State University at Fullerton 

. y Mr. Robert B. Boyden, Audit Officer 

Dr. Eloise E. Clark, Director, Division of Biological and 
\^ Medical Sciences ^ \ 



Dr. James D. Cowhig , Deputy Director for Public Sector Productivity 
Mr. Walter M. Hudson, Budget Officer 



Dr^J. Arthur Jones, Program Analyst, Office of Planning and 

/ Resources Management 

% ' 
Mrs. Maryann B. Lloyd, Deputy General Counsel 

Mr. Leonard A. Redecke, Contracts Administrator 

12 ■ 
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' Dr. Joel A, Snow, Director^ Office of Planning and Resources 
Management (Executive, Secretary of Review Team) 

The team will make *its report -to me on May 14. The National Science 
Board will review the findings at its meeting on May 15 and 16, and 
I shall report. to you after that review. 

In order to get outside opinion as well, I will ask our Advisory 
Conlmittee on Science Education to consider and advise on the report 
of \thli, internal group in a draft stage. The Advisory Committee is 
composed of the following: 

1 ■ , 

/ Dr. M. Ann Grooms, Chairperson 

President, Educational Services Institute, Inc. 
C inc inna t iT"^Oh io 

Dr. Richard D. Anderson 
Department of Mathematics 
Louisiana State University 

^ Dr. J. Myron Atkin 

Dean of Education 
University of Illinois v 

Dr. Ernest A. Boykins, Jr. 

President, Mississippi Valley State College ^ , 

Mr. John Burnett, undergraduate^, student 
Oregon State University * 

' , Dr4 Susan Goldhor „ 

Dean, School of Natural Science 
Hampshire College, Amherst , Massachusetts 

Dr. Robert Karplus 

Lawrence Hall of Science 

University of California at Berkeley 

Dr. Bernard Luskin 

Vice Chancellor - Educational Development 
Coast Community College District 
Costa Mesa, Califq^rnia ' 

Dr. Michael Scriven 
Professor of Philo*sophy^ 
•University of California at Berkeley , 

Dr. John G. Truxal 

Dean of Engineering ! | 

State Univers'ity of New York ^t Stony BTook 

, 13 ' I 



Dr- Carl M, York, Jr. 
Denver , Colorado* ^ 

I trust thkt the plans for the internal review of the pre-college 
curriculum development and implementation demonstratas our intent to 
provide sufficient addi?tional oversight and review to the pre-college 
curriculum programs. 

Sincerely yours, 



H. Guy ford Stever 
Director 

Copy to: \ 
Representative James W. Symington 
Representative Charles A. Mosher ^ 
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NATIONAL SCIENCE FOUNDATION 
WASHINGTON. D C. 20550 

•^nnsf ^ April 2, 1975 

'A 4'^^ ■ . . . ■ ■ 

OFFICE OF THE \ 

DIRECTOR \ ' . 

Dr. Joel a; SnoW ^ 
Director, Office of Planning 

and Resources Management 
National. Science Foundation 
Washington, D.C. 20550 

Dear Joel : 

As you know, the, authorization and appropriation hearings on the 
FY 1976 budget, the posture hearings, and other recent interactions 
with the Congress have brought to the fore a number of Foundation 
programs and procedures over which there is deep Congressional 
concern • Among these, the one viewed in the Congress and by the 
National Science Board as deserving immediate attention is the . 
concern over. policies guiding the Pre-college Education in Science 
Program*" In order to review thoroughly the Foundation's activities 
in this area,- I am appointing an ad hoc study comnittee that will 
^ be headed by Assistant Director Robert Hughes •Because of 
your professional background and your position in the Foundation 
management, I am designating you a member of the study team. The 
other members of the team and the general scope of the work for the 
review is outlined in the letter to Congressman Olin E. league 
l^^hich is enclosed. 




general schedule for the study team's work is as follows: 



April 3-4 Organization of committee by Dr. Snow, the 

Executive Secretary. 

April 7 ..... . First meeting with Dr. Hughes, development 

of detailed wdrk schedule for month of April. 

^ I May 1 . . Completion of first draft of report and 

recommendations. 

May 4-5 Meeting between the ad hoc study committee 

- " and-the-Advisory -Committee on-Science - 

Education. 

. May 13 Submission of final report to NSF Di,i^ector. 

May 15 NSF Director reports to NSB. 

May 19 NSF Director reports to Committee on Science 

and Technology. 
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Jhe organization meeting of the study team will be. held on April 3 
between 2 and .4 p.m. 

I know that you and the other members of the review team all have 
very heavy schedules,. I am asking you, however, to have your normal 
work handled by other people in your office to the extent that is: 
necessary to have a thorough review of the pre-college curriculum 
activities. There is no issue before the Foundation at the moment 
of greater importance^ and I am confident that you will give this 
the attention that is required. 

Sincerely yours. 



H. Guyford Stever 
Director 

Enclosure . 
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OPTIONAL FORM NO. 10 .. . 

JULY I #73 COITION 

GSA Ff»MR (41 Crft) lOKILft 

United states government 

Memorandum 

Chairman, Science Curriculum Review Committee DATE: April 17, 1975 



The Director 

; 

/ 

Scope and Charge for the /Committee 

• /' 

My Letter of April 2, 1975 and Attachment 



I am pleased to learn' that the initial organization of the study of our 
curriculum development procedures is well underway and that your group 
is moving forward at its tasks. I know that you are well^ aware of the 
importance I attach to this undertaking and the value it should have in 
improving our approach to this and other areas of Foundation management 
practice. Let me reinforce certain issues which must be clearly 
addressed. .1 expect that your committee will thoughtfully assess whether 
in these programs, our procedures ensure that: 



the proposed subject matter fits within reasonable limits 
o or norms with respect to educational value; 

o the scientific content is accurate; 

o the course developers are responsible and competent persons; 
o the institutional and contractual arrangements are sound. 

The expanded outline (attached) for study which you have submitted to me 
is approved. I am in general accord with the way you are proceeding. 
However, Fwant to stress several further points to keep in mind. You 
must insure that: 

the study and analysis is in all respects independent and . 
objective, 

t he exam ina t ion~6 f cases and experience is complete and 
unbiaised by our previous practices, 
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the scrutiny of our fiscal and management approach is 
thorough and unhindered by past commitments, 

potential or real conflicts of interest are carefully! 

addressed, 

NSF policies and practices are carefully scrutinized 

to ensure that the appropriate role of NSF in curriculum 
development is being followed* 

In t^ process of fulfilling this responsibility you must ensure that: 

_ a through examination of past practices is iiridertajcen 

^ a rigorous analysis of business and contractors relation- 
ships , is. developed, and 

positive recommendations for improving the program's 
practices are developed. 

A fully effective analysis of these issues is essential to hone^t^ 
examination of the integrity of our curriculum programs. 

As you know j I am committed to reporting our conclusions to the Congress 
after appropriate discussion with the Advisory Committee for Scienc^ 
Education and. the^ational Science Board. /Your work is a crucial 
element in formulating this report. Let me urge you to require that in 
every respect that this study , will -be a model of objective ind pro- 
fessional analysis. «' : 

I urge you to make the full use of Foundation staff and the scientific 
community in carrying out this analysis. My remarks to you and the 
staff involved in this study at your first' meeting indicate how 
important I feel this study is to the NSF. There is no issue before 
us o£ greater importance and I. am confident that you will give it the 
attention that . is needed. 



H. Guyford Stever 
At tachment ; ~ 
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History of NSF Involvement in Pre-CoUege Science Education 



In Science, The Endless Frontier, which 
provided the rationale leading to the establish- 
ment of the National Science Foundation, 
Vannevar Bush and his advisory committees in- 
dicated a concern for (1) broadening the base 
from which students with scientific aptitude and 
talents could, be drawn, and (2) filling the war- 
time deficit of scientists and engineers. The 
problem of teaching did not go unnoticed and the 
report stated: 

Improvement in the teaching o( science is imperative, for 
■students of latent scientific ability are particularly 
vulnerable to high school teaching which fails to interest or 
'provide adequate instruction. 

The National Science Foundation Act of 1950 
authorized and directed the NSF along with other 
functions, "to develop and encourage the pursuit 
of a national policy for the promotion of basic 
research and educalionin the sciences.** U stated 
that it shall be one of the objectives of the NSF to 
strengthen basic research and education in the 
sciences. 



The Early Years 

NSFs initial response to its mandate to sup- 
port the promotion of basic research and educa- 
tion in the sciences was in the form of fellowships 
for graduate education in the sciences. During the' 
first years NSF effort in science education focus- 
ed on the training of graduate students: although 
\ there were some evident concerns as to the quali- 
\ ty of faculty at the undergraduate level. Other ^- 
-\tivities through which the Foundation could 
\make major contributions to strengthen science 

education were studied. ^ 

— ^^rNSFhad^reFogmzecriha^^ its primary 

Responsibilities in achieving scientific progress 
W.as the training of scientific manpower. While 
.„tlie..problem of scientific, manpower was to be 
relolved in the short term through graduate 
felTowships, improvement of the quality of 
scieVice instruction in the schools would take 
place through a program for individual science 
teachers to spend summers at research conlcM-snr 
special seminars, and by the establishment of in- 



stitutes for summer research. This effort evolved 
into the Institute program. 

Early justification for science education 
programs centered on perceived critical shor- 
tages of scientific and engineering personnel and 
indications that such shortages would continue 
for at least a clecade. While a small amount of 
money vvas to be earmarked in the FY 1953- 
budget for methods, for increasing the effec- 
tiveness of institutions of higher learning and in- 
creasing the quality of training in the sciences, 
assistance and support would be primarily given 
to teachers of science participatingin summer in- 
stitutes. At these institutes teachers would keep 
abreast of new developments in their particular 
field, have an opportunity to carry on indepen- 
' dent investigations of their own, obtain informa- 
tion on the latest techniques in teaching and in 
other ways to develop their usefulness as 
developers of.scien^tific talents 

During the Senate Appropriations hearings on 
the FY 1954 budget, the point was made that lack 
of quality among secondary school teachers 
would have an effect on the production of scien- 
• tists. The fiscal year 1955 budget contained a for- 
mal indication of concern for secondary school 
science education. The budget justification 
stated "The fact that over two-thirds of ourliigh 
school graduates, having at least the intelligence 
of college graduates, do not enter college in- 
dicates that greater emphasis, encouragement 
.and stimulation relative to the advantages of ad- 
vanced study in the sciences as well as in other 
fields must.be provided at the high school level if 
this potential is to be fully developed.** In late 
calendar year 1954, it was pointed out that high 
quality scientists or engineers were 'not being 
trained in quantities sufficient to nieet future 
— cnrmbiii ed'lnvi^r^^ uiTe irTO nlir- 
' Thli FY 1956 budget stated that the "seriousness 
of the scientific manpower situation makes it im- 
perative that the Foundation accelerate it's 
program of education irt the sciences as rapidly as 
possible.** The budget/ element Education in the 
Sciences describedUl/e situation: "The widening 
/ gap between the demand and supply of teachers 
of scitjnce in the years ahead is possibly the 
greatest obstacle to the training of adequatii 
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numbers of high calibre scientists. Teachers, in 
order to teach and inspire •more and better 
teachers of tomorrow m^st themselves be made 
more competent or imaginative and more 
stimulating. If they are they will help produce the 
many high ability students that must be inspired 
to pursue careers in science so that there would 
be assurance of an adequate supply of high quali- 
ty scientists and science teachers in the future." 
The Foundation proposed that teachers from high 
schools and the small liberal arts colleges meet at 
institutes to learn from first-rate researchers and 
expositors about the more important and unify- 
ing concepts in their fields. These teachers, arm- 
ed with new information, insight and eiithusiasm 
would bring to- their schools and students new 
thinking about their teaching materials, methods 
and objectives in the light of modern scientific 
research/ Also a five-point exploratory effort 
was proposed. First, conferences at which out- 
standing scieiitists and teachers of science would 
gather to discuss new developments in science 
with a view to determining what place, if any, 
these developments ought to occupy in the 
science curriculum would be held; included were 
conferences directed toward consideration of 
support of college science programs for non- 
science students. Second, concepts and methods 
of modern science were to be incorporated into 
science curriculum at both high school and 
college levels by th^^Jreparation of syllabi-broad 
outlines of topics with ex-amples of presentation 
and collections of appropriate new problems. The 
syllabi would be distributed to teachers around 
the country, adapted to local needs and thus 
stimulate the competitive writing of new and 
modern textbooks by the individual teachers 
themselves. Third, conferences between scien- 
tists and educators were proposed to develop ex- 
perimental programs for the improvement of 
teacher quality. Fourth, effective teaching aids 
would be made available, particularly for those 
high schools where the staff was small and a 
science-teaehei^-would-be-expected-to frequently 
teach courses in two or more fields of science. 
Fifth, special studies would be undertaken to 
determine the nature of theproblem in improving 
science curriculum and training of science 
teachers. 

During National Science Board discussions on 
science education in 1955 the NSB asked that 
primary consideration be given to the improve- 
ment of high school science curricula. A state- 



' ment to the Senate Appropriations Committee on 

- the FY 1956 Budget indicated the need for im- 
provement of science curricula. 

The Appropriation Act for 1956 established a 
floor on the availability of funds for the Summer 

, Institutes for secondary school teachers which 
continued until the FY 1973 appropriation. This 
was in recognition, of the importance placed on 
this form of science education by the Congress. 

Stress was put on the fact that both short- and 
long-term programs were needed to increase the 
supply of competent scientists. Recognition was 
given to the fact that a considerable portion of the 
responsibility for attack upon the overall 
problem belonged to educational institutions and 
that ways and means must be found to stimulate 
and assist them in fulfilling their respon- 
sibilities. Arguments were given that thecountry 
had a grave, actual and potential shortage of 
scientific manpower and a critical limiting factor 
in developing latent science talent and produc- 
tivity was a dwindling supply of science 
teachers. The Education in Science Program was 
expeded to encourage universities to develop 
and offer as part of their regular programs more 
(effective plans for training in-service and poten- 
tial science teachers as well as* encouraging 
secondary school administrators to provide 
science teachers with opportunities forobtaining 
additional training. 

The FY 1958 budget highlighted for the first 
'time programs. for the improvement of science 
curricula as well as teacher training and early 
identification, motivation, and counseling of able 
students with/Scientific aptitude. The, objectives 
* of the education in the sciences program were 
stated as "to stimulate improvement of science 
teaching at all levels by supporting specially 
designed supplementary courses in science for 
high school and college science teachers, to 
stimulate the search for new and better ways of 
identifying and motivating people withscientific 
ability to enter upon scientific careers, and 

-stimulating the search for ne w and better ways of- 
t raining high school and college science 
students." The 1958 budget was the first in which 
funds for a Curriculum Developnrient Program as 
a separate activity were requested. The-bulk-af 

*the funds were to be directed toward supplemen- 
tary teaching aids. A smallamount of money was 
earmarked for subject matter syllabi for science 
teachers. This was to support efforts by various 
professional and educational organizations in 
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reviews of the status of teaching materials in 
their fields and to develop syllabi reflecting 
current information and findings. 

The thrust toward making more students 
choose careers in the sciences and. interesting 
more in scientific research and teaching was con- 
:. tinued in the fiscal year 1958 budget. Basic 
...research had advanced knowledge at an un- 
j;;'precedented rate and far too rapidly to be 
' reflected either in the training of science teachers 
or in the textbooks and other instructional 
' materials which they used. The immense store of 
new knowledge had to be critically examined and 
those new cr\icial elements be selected for use, 
which together with the old, would provide the 
necessary foundation at each educational level. 

The improvement of course content and in- 
structional materials had two principal aspects, 
the development of new curricula materials bas- 
ed on new concepts and new advances in science, 
and the transmission of better course material 
{both new and old) to the teachers along with 
training in their interpretation and use. Training 
of science and mathematics teachers was to be by 
institute programs, science faculty fellowships, 
and other -specialized efforts. All were focused 
sharply upon'^ubject matter. It was accepted that 
the development of new curricula materials had 
to be a major effort if tangible results were to be 
produced within a reasonable time. Large 

\ amounts of materials were to be sifted and 
evaluated for retention or discard. The judgment 
of numerous experts in the particular field under 
. consideration would be required. 

There was a caution indicated: ''Because the 
decisions are of such importance the Foundation 
is especially watchful, lest its role be mis- 
construed. In this prqgrarp as in most others the 
Foundation supports the activities of competent 
persons and groups in the scientific and academic 
/communities in carrying out what those com- 
munities judge to be needed and proper. The 
Foundation takes pains to avoid wherever possi- 

ble t h e implication of endors ing or spedfyjng_al- 

' titudes, the nature of course content, or related 
items which are properly the province of the 
educational community.. The initiative must 
__.^xlve_£rom4-ho-^,ademiG-Gommun4 t-y ( FA"- 1 



budge't) Recognition was given to the fact that the 
selection of curricula items or concepts by com- 
petent specialists was only the beginning. The 
items had to be organized into course materials 
and made available both to teachers antl 



students. It was obvious that an individual in- 
vestigator or even a single institution could not 
find the resources required for a project of such 
magnitude. The Foundation was, therefore, giv- 
ing support to careful reexamination and revi- 
sion of the subject matter taught in certain of the 
scientific disciplines. The studies were under- 
taken by emminent scientists—wwk-ing in \ 
cooperation with competent and experienced 
teachers. 

A major new element was established entitled 
Course Content Improvement Program. The 
justification was that a fundamental aspect of the 
solution to the problem of securing greater 
numbers of competent scientists and science 
teachers is providing strong emphasis upon 
development of new courses of study containing 
the latest knowledge appropriate for all levels of 
the educational system. We also begin to see 
creeping into the justification concern for 
relating scitftice education to intellectual and 
cultural disciplines and the need of the responsi- 
ble citizen to judge technological and scientific 
questions becoming important. 

The fifties were a period of evolution as NSF , 
worked to isolate the problem it wished to 
resolve. By the end of the decade, it was clear that 
substantial effort was needed in curriculum 
development and that there had to be some way 
of introducing the educational community to 
these new ideas. Tlje program continued with 
two approaches— training of teachers thrpugh 
the institute program and the curriculum 
development effort. 



Curriculum Developpient 

The Foundation's Sixth Annual Report (1956) 
had identified science education from high school 
up through graduate school as a long range and 
continuing problem for American science. The 
jeporJ^iutth.erJndiiiaLe.d^tliat resDiuiion-of-Lhe- 
problem would require not only upgrading of the 
competence of instructors, but of the quality of 
courses being taught-, The initial statement of 
generttl-prirnnplesnTi-STrpport-o^cDurse cuiil:eTTl~ 
improvement was developed and endorsed by the 
Advisory Committee for Education at its 
November, 1958 meeting. 

In order to trace F^oundation support for 
curriculum development it is advisable to place it 
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in the. context of other activities in the field at 
that time. Since education in the United States is 
.traditionally a function of the individual states, . 
responsibility for the development of curriculum 
studies and curriculum guides began and has 
•remained with the States.lmmediately following 
World War Il^everal states and some large school 
districts allocated substantial staff resources to 
the development of curriculum guides but then, 
as now, the great bulk of curriculum materials 
were produced and distributed by the private 
publishing houses. There were indications in the 
early l^SOs, however, that this pattern was 
changing. A number of Federal agencies had 
begun to use appropriated funds to augment the 
V materials available for classroom use to update 
secondary and elementary science curricula. 
> These efforts were not directed at complete 

development or revision but were rather to 
supplement existing curricula. The Atomic 
Energy Commission provided for the develop- 
ment and distribution of special instructional 
^material dealing with new scientific concepts 
and findings, and similar efforts continue to the 
present time. 

Private foundations were beginning to support 
augmentation and updating of curricula. In 1951 
the Carnegie Corporation provided support to the 
University of Illinois to undertake complete revi- 
sion of the secondary mathematics curriculum in 
what came to be known as the University of Il- 
linois Committee on School Mathematics. This 
development effort was continued for a number 
of years and ultimately was funded as wellby the 
United States Office of Education. Another pro- 
ject was supported by the Foundation for the Ad- 
vancement o£ Education to film a complete, 
although conventional, high school physics 
course and subsequently to evaluate its effec- 
tivene^ss in the schools of several states. In 1957, 
^ the same foundation made a grant to the Univer- 

sity of Florida to produce a cqmp|lete high school 
chemistry course on film. Increasingly during the 

— t9d0sv~Federal'agencie5rTTTcluding"the-©ffice-of" 

, Education, expanded curriculum rebuilding to 
other areas including English and the social 
studies. 

The initial entrylof the INationai Science Foun~ 
dation into the field of curriculum reform grew 
from an idea proposed by Professor Jerrold 
• Zacharias at the Massachusetts Institute of 
Technology. Originally, the proposal involved 
only a film course on physics which would at 



once update the curriculum and bring high school 
students in touch with distinguished scientists. 
In fiscal year 1956. the Foundation granted an 
award of $300,000 for a feasibility study by a 
committee of physical scientists under 
Zacharias' leadership. A result of early meetings 
of the Physical Science Study Committee (PSSC) 
was the conviction that a mere filmed course was 
insufficient, and the plan^ for the PSSC moved 
toward development of.an Updated text as well as 
filni, special experimental materials, and 
laboratory exercises. 

In 1960, the Foundation made a grant to the 
American Association for the Advancement of 
Science to conduct a study of the place and - ^ 
character of science instruction in elementary ^ 
and junior high schools. The study queried 200 
leading scientists, teachers and school ad- 
ministrators during the 1960-61 academic year; 
they strongly recommended a large scale effort to 
develop scientifically sound and pedagogically 
feasible programs in sciencjB for students in the 
first nine grades. The steering committee of this 
project made riecommendations which were in- 
cluded in an article in Science Magazine in 1961. 
These were: > 

(1) science should be a basic part of general education for all 
students at the elementary and junior high levels; (2) instruct 
Won at the elementary level should deal in an organized way 
with science as a whole; (3) there must be a clear progression 
in the study of sciencefrom grade to grade; (4) there should be ' 
no single common national curriculum in science; (5) science 
leanhing should stress the spirit of discovery characteristic of 
science itself; . (6) new' instructional materials must be 
prepared for in-service and pre-service programs for science 
teachers; (7) in the preparation of instructional materials, we 
require the combined effort of scientists, classroom teachers, 
and (8) there is a great'urgency to get started on the prepara- 
tion of improved instructional materials in science. 

y 

From 1961 through 1964 the Foundation funded 
several feasibility projects on the elementary 
school level; four of these became major 
curriculum development efforts. They are: 

~-Sc:Tence-Gurricuiunr-4mprovemen^t Study. - Un- — 
iversity of California, Berkeley; Elementary 
Science Study, Educational Development Cor- 
poration; Minnemast Project, University of 

—M innesu t a; and Scien c e, a P rocess Appraacfar— 
American Association for the Advancement of 
Science. 

The Foundation, therefore, began its efforts in 
scientific education with the primary goal of up- 
grading the subject matter knowledge of secon- 
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dary school teachers in the belief that this would 
indirectly improve science education for 
students. However, reevaluations were changing 
the Foundation's perceptions of its means for 
carrying out its mandate. By the late sixties the 
Foundation had already supported 50 percent of 

V all secondary science and math teachers in some 
form of institute activity. 

The Seventh Annual National Science Founda- 
tion Report [1957) officially linnounced an 
organizational unit within the Foundation to con- 
sider proposals for curriculum ' development. 
Special Projects in Science Education had three 
principal charges: (1) curriculum studies; (2) stu- 
dent participation projects; (3) teacher training 
projects.. The Curriculum Studies Group, known 
as the Course Content Improvement Program 
from 1957 through 1971, became the Curriculum 
and Instruction Development Program in 1972 
and from 1973 until the present time has been 
called the "Materials and Instruction Develop- 
ment Section/' 

In 1962» the Foundation published "Science 
Course Improvement Projects" (NSF 62-38) to 
disseminate information on the projects it was 
interested in considering for funding. The first 
brochure as well as all subsequent revisions, the 

V- most recent of which is E-74-30 published in 
1974. contain the following paragraph in the 
Foreward: . 

*rh(! purpose (if this bonklel is to help make information wide- 
- ly available on science improvement projects siipporled liy 
the National Science Foundation. Decisions on what to teach 
remain, in the healthy American tradilicm. tho exclusive 
' responsibility of individual schools and teachers. The 
National Science Foundation does not recommend the adop- 
tion of any specific book, film, piece of apparatus, course or 
curriculum. It is hoped, however, that the products of these 
projects will prove to merit serious cf)nsnieration by ever^' 
school and ccjlle^e. j 

The guiding principles for the developmen^t of 
course content projects stated clearly that ^SF 
w^ould s_up port resea rch andj^evejopmem 
substance of courses an^ the tools of instruction. 
However. Foundation funds were not to |ie used 
to. promote the adoption of any -specific 
lum_ roiirsr of instructiona l materials: 
they were expected to compete on their own 
merits. Each teacher and school. must be free to 
decide if and how to use the products developed. 

It became evident. hovv(?ver.. that the diffusion 
and utilization of a radically nnw curriculum 
would not occur spontaneously. A basis for 



deciisionmaking 'by teachers and school ad- 
ministrators was needed and therefore every ef- 
fort was to be made to widely distribute project 
information. In addition NSF vybuld provide for 
special training and technical assistance to effect 
full implementation*. 

In the area of curriculum development, the 
Foundation tried not toleadbut to follow thecon- 
sensus of both the scientific community and the 
Congress which had frequently urged that im- 
proved science teaching be extended to the secon- 
. dary and then to the elementary schools, An in- 
dication of the concern of the Congress. for im- 
provement of education was demonstrated by 
passage of the "National Defense Education Act 
of 1958" which focused largely upp.n the improve- 
ment of education in mathematics, science, and 
modern foreign languages, 

In 1969, the National Science Board requested 
the Advisory Committee for Science Education to 
. evaluate the effectiveness of the Foundations* 
program in science education, including course 
content improvement, and to make recommen- 
dations for the decade of the seventieS^'That 
report recommended the following; 

Increased emphasis on the understanding of scierice and 
technology by those who are not, and do not expect to be, 
professional scientists and technologists. 

tireatly increased support for the sorial and behavioral 
sciences with particular emphasis on the area of pre-college 
education. 

First generaticm Cnur.se Content Improvement Programs still 
in progress should be .supported to their conclusions. 

Secfmd generatiim efforts should hv. focused on inler- 
diiicipliiiary. problem-oriented approaches that provide for 
differences in student abilities, backgrounds, and vocational 
objectives. 

In 1973 following a reexamination and a 
reorganization of the Foundation s perceptions of 
its science education mission (a reorganization 
which included substantial inputs from the Of- 
fice of Man agement and Budget), there was in- 
creased emphasis on tlie development 6T scien- 
tific literacy in all citizens and the establishment 
of an elementary and secondary school develop- 
• ^ mcnt p rogram. This change is reflected in the 
Guide for tho PniiniYoiion of Proposals for 
Motcriak (ind Inslruclioiwl Dovolopniont Proj- 
licls (May 1974. E-75-3), The program policy 
emphasizes the CDmplete freedom of the study 
groups to develop the materials ncnnrding to their 
..host iudyment. which should not be unduly in- 

z i 



EKLC 



23 



1 



fluenced by any pressure group or member of the 
. . ^ National Science Foundation. "There must be no 
implication of governmental responsibility for, 
nor endorsement of, the content or organization 
of the materials." 

Curriculum Implementation 

The Foundation has increasingly recognized 
that the development" of innovative curriculum 
materials is not of itself sufficient to assure 
utilization. Implementation is a complicated un- 
dertaking vvhich begins soon after the develop- 
ment process is initiated. Creators of new 
educational materials start providing informa- 
tion about their activities to engender an 
awareness b^tbe expected products. Another 
step in the development process- field-testing 
and trial use of materials-contributes to early 
dissemination efforts. Thus, there is no clear line 
separating materials development and materials 
implementation — they overlap and both are to 
some extent parts of a single process. 

Normally, implementation is considered to en- 
• compass (a) dissemination of information about, 
and (b) activities which may lead to the^adoption 
by schools and school systems of new 
educational materials and techniques. Visualiz- 
ing implementation in this fashiop leads touseof 
a multi-stage model for the implementation 
process. The first stage of the process encom- 
passes awareness activities for the dissemina- 
tion of information about materials tn curriculum 
decisionmakers. This is fallowed by activities 
designed to develop an interest in the materials 
(i.e., training of resource personnel). Utilization 
on a trial- or preliminary basis, (which may 
overlap^with final development) enables poten- . 
tial users to examine the characteristics of the 
materials in the field. Finally, adoption, takes 
place at the school system or classroom level. At 
" thisr^tag(ff-1nfTplie7nentation~imtiv 
orientation for key teachers, seek to bring about 
effective use of the materials by a critical number 
of the students for whom the materials are plann- 
neH^'THendegreeand nature of houndat ion support 
has historically varied among these stages. 

Although the Foundation has long been con- 
cerned with the effective utilization of 
. curriculum materials developed with its support, 
its emphasis on implementation has become more 

■ \J 
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apparent in recent years. The Foundation has 
provided support for a variety of implementation 
models, and its policies and procedures concer- 
ning implemehtatibn have tended to evolve. 
Tables 1-4 show in terms of dollars, and number 
of participants, the type of programs to be dis- 
cussel^i. 

The Pre-College Instructional Improvment Im- 
plementation Program officially began in fiscal 
year 1974 as the result of evolution of pre-college 
science education activities which first received 
NSF support in fiscal year 1954. These programs 
wei;e multipurpose in nature and not solely 
^directed toward implementation. 

Early in NSF history it was determined that the 
Graduate Fellowship Program specifically men- 
tioned in the original NSF Act was not necessari- 
ly the only or the most effective way to mcrease 
the research potentiaPbf the Nation. In fiscal year 
1953, an experimental program of two summer 
' workshops, called institutes, for college teachers 
were supported, followed in 1954 with support 
for three summer institutes for college teachers 
and one for high school teachers. These early in- 
stitutes were patterned after industrial.models, 
such as those supported in the late'1940*s by 
General Electric, Westinghouse, Shell Oil and 
others. The institutes were generally of 6-8 
weeks duration and in the early days restricted to 
concern with a single scientific discipline. 
The original goals of these institutes were: 

(1) to increase the effectiveness of teachers by 
broadening and updating their scientific 
background; 

(2) renew interest in an attitude of teachers 
toward science and their task as a factor in the 
motivation and encouragement of their 
students; 

(3) improve communications, sympathy and 
understanding between groups (researchers 
versus teachers, for example). 

' These original goals while remaining much the 
same brought forth additional and diversified ob- 
jectives^ \ 

(1) updating of subject matter knowledge for 
those who were once adequately prepared; 

(2) remedial training for teachers who were in- 
itially ill prepared; 
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Table 1 

> SECONDARY SCHOOL TEACHER EDUCATION PROGRAMS 

SUPPORTED BY THE NATIONAL SCIENCE FOUNDATION 



Summer Institutes In-Service Institutes Academic Year Institutes Summer Conferences 



Fiscal 


























Year 


' 1 


2 


■ '/S , 


1 




3 


1' , 


'L 


3 


1 


2 


3 


• ' ^ J \ 


■ '■ 1 


27 


$10,900 




















1955 


6 


143 


72.350 




















.1956 


18 


750 


383.750 


2 . 


90 


$11,950 


2 


100 


$504,700 








' • * 1957 


94 


4,800 


4.878.462 


21 


635 


150.350 


16 


781 


4,250,885 








' ^"^"""-^8 

1959 


122 


6.200 


6.543.625 


85 . 


3.000 


■ 623.780 


19 


925 


5,144,300 








327 


17,000 


19.114.056 


184 


8.725 


1.861,685 


32 


1,508 


8,648,580 








.1960 


351 


17.350 


19.994.600 


191 


9.026 


2.179.670 


33 


1,491 


9^015,600 










355 


17,692 


20.838.200 


253 


11.633 


2.887.555 


40 


1,494 


9,470,470 








1962 ....... 


413 


20,469 


24.071.800 


284 


13.826 


3.597.040 


52 


1.725 


10,979,700 












20.450 


24.139.200 


268 


13.436 


3.512i780 


56; 


1.755 


10»985,qjD0 






$35,700 


•.■.1964 


431 


20.355 


24.175.776- 


282 


13.085 


3,524.080 


59 


1,685 . 


10,997,500 


2 


55. 


; 1965 ....... 


, . 44T 


20.492 


24.295,230 


313 


14.460 


3.614.543 


64 


1,644 


11,021,990 


7 


322 


113,000 


1966 ....... 


462 


20.390 


24.012,670. 


266 


13.445 


3.171.090 


63 


1,547 • 


10,508.537 


6 


172' 


79,285 


1967 


428 


19.393 


22;79i;300 


270 


12.941 


. 3.375,515 


63 


i.503 . 


9,781,500 


22 


627 


249,080 


/l968 


442 


19.337 


. 23.l99.220 


311 . 


14.410 


4.039.644 


61 


1,446., 


9,262,136 


27 


.885 


368,451 


1969 


421 


17.823 


21.432.483 


279 


12.914 


3,560,476 


67 


1.367 ' 


8,924,768. 


16 


473 


208,324 


1970 ....... 


437 


18.735 


22.912.311 


335 


15.789 


4.434,394 


64 


1,329 


8,453,844 


22 


782 


322,713 


1971 ....... 


428 


18.549 


22.772.970 


226 


11.663 


3,376.263 


28 


444 


2,722,693 


.29 


1,069 


421,165 


1972 .. 


264 


10.218 


13.805.297 


208 


9.226 


3,191,910 


25 


340 


2,666,584 


19 


583 


297,501 


1973 


237 


8.454 


11.292.037 


39 


1.697 


517.565 


23 


369 


•2,378,950 


19 


583 


291,050 



6.0B4 278,629 $330,705,337 3.817 180,053 $47,630,290 767 21,453 $135,717,737 16 5.551 $2,380,299 



Research Participation 
12 3 



1959 47 =443 $601,230 

1960 (>3 497 833,527 

1961 51 351 691,405 

1962 48 369 735,435. 

19B3 37 304 050,530 

1964 ■ 41 359 766,180 / 

1965 ' 44 355 763.445 

1966 53 360 785,240 

1957 i 60 377 816,300 

: 1968 .' 62 ,377 846,420 



506 3,792 $7,489,712 



1 Nci. of Grants 

2 No. of Participants ^ ^ 

3 Amount ObliJ^alcd. 
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Table 2 

COOPERATIVE COLLEGE-SCHOOL SCIENCE 
PROGRAMS 
(SECONDARY AND ELEMENTARY) 
SUPPORTED BY 
THE NATIONAL SCIENCE FOUNDATION 



" Fiscal 
Year 


1 


2 


3 


1960 




Not Available 


$53,090 


1961 . : . . . 


19 


" 55 


367,185 


1962 


34 


280 


525,530 


1963 


44- 


' , 689 


744,130 


1964 


42 


934 


749,525 


1965 


. - 46 


1,576 


913,330 


1966 


56 


3.230 


1,929,305 


1967 .i.. 


56 


3,424 


2,296,295 


1968 


~~ 64 


4,502 


3,182,795 


1969 . . . 


146 


7,191 


5,596,241 


1970 


148 


6,309 


5,441,931 


1971 .... 


158 


6,296 


4,898,741 


1972 . . . . . 


142 


8,435 


4,568,081 


1,973 


81 


4,247 


2,376,256 




1,057 


47,168 


$33,642,435 



Table 3 

RESOURCE PERSONNEL WORKSHOPS 
, SliFPORTED BY 
THE NATIONAL SCIENCE FOUNDATION 



Fiscal 
Year 

1907 

1968 

1969 

1970 

1971 

1972 

1973 



1 


2 


3 


6 


178 


$297,000 


18 


733 


862.637 


26 


868 


1.374,500 


31 


1,092 


1.259.183 


36 


.1,347 


1.517.265 


25 


885 


1.246.800 


9 


396 


522.700 


151 


5,499 


$7,080,081 



Table 4 

ELEMENTARY SCHOOL TEACHER EDUCATION PROGRAMS 
SUPPORTED BY THE NATIONAL SCIENCE FOUNDATION 





Fiscal 
Year 




In-Service Institutes 






Summer Institutes 




1 


2 


3 


1 * 


2 


3 


1959 , , 




11 


345 


$80,600 


12 


515 


$470,300 


1960 . . 




13 


405 


73,990 


16 


545 


522.100 


1961 




35 


1,029 


200,930 


19 


649 


656.500 


1962 .. 




35 


1.060 


202,665 


21 


712 


710.100 


1963 , 




46 


1,423 


299,760 


• 34 


1.046 


1.062.300 


1964 . . 




70 


2,118 


464,630 


37 


1.236 


1.270.789 


1965 . . 




62 


3,082 


466,040 


39 


1.459 


1.271.860 


1966 . . 




55 


4,225 


513,790 


26. 


926 


769.850 








327 13.687 


$2,302,405 




204 7.088 


$6,733,799 



(3) specific background training to equip 
teachers to teach newer curricula materials; 

(4) training in depth to enable teachers to meet 
new higher standards (such as those 
rfepresented by a Masters Degree); 

(5) advanced specialized training for teachers 
and supervisors preparing for positions of 
leadership in science education. 

Priority ranking of these objectives varied 
between the various institute programs and 



shifted over time. For example, in the earliest 
years objectives (1) and (4) (updating of subject 
matter knowledge and training ih depth) were the 
sole objectives addressed by institutes. But by 
the 1970s specific background training and ad- 
vanced specialized training (objectives (3) and 
(5)) became vitally important. 

Remedial training for teachers became a 
recognized need with the 1956 program. In fiscal 
year 1958 these institutes became a vehicle for 
training teachers in the utilization of newly^ 
developed curriculum materials. This shift in 
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emphasis can be traced to the work done by the 
Physical Science Study Committee which 
recognized that teaching materials being 
developed were such a radical departure from 
what had been used during the past fifty years 
that, all teachers needed more training if they 
were to handle the new courses. 

Five summer institutes held in fiscal year 1958 
were oriented to. the Physical Science Study 
Committee's program. In the next year there were 
13 such programs. As new course materials 
became ready for classroom use, institutes were 
established to handle the orientation of teachers 
to these new curricula. These institutes enabled 
teachers to learn more subject matter and to see 
therelevance of new subject matter in the courses 
Ihey taught in high^school. By 1965 it was, es- 
timated that approximately 20 percent of the^ 
summer institutes had a major orientation 
towards, one of the revised curricula. This 
percentage did not vary too much from then until 
1973, the formal termination of the summer in- 
stitute program.* ^ 

By 1956-1957, it had become clear that high 
school teachers' background in subject matter ' 
was even weaker than had been anticipated. A 
new program. Academic Year Institutes (AYI), 
was characterized by full-time programs of in- 
V tensive study leading in many cases to a masters 
\degree. From the beginning the program focused 
tnainly on the objectives dealing with updating of 
Subject matter knowledge, training in depth, and 
advanced specialized training for teachers. 
Degrees especially designed for teachers were es- 
tablished bearing such names as Master of 
Science Teaching, Master of Arts in Teaching, 
and Master of Education. Starting about fiscal 
year 1966 the AYI program moved more strongly 
to provide leadership training f6r supervisors 
and curriculum specialists instead of for the 
regular classroom teacher. While not starting out 
to be a direct implementation vehicle, the AYI 
program by fiscal year 1973 was totally devoted 
to praviding leadership training for supervisors 
and curriculum specialists in implementation 
strategies and means for improving the secon- 
dary scliool curriculum in science and 
mathematics. In {act, in fiscal year 1973, the 
program name was changed to Leadership 
Development Program. It should be noted that 



* The cited percentage includes only those institutes 
specificaUy labeled with one of the curriculum alphabets. 



the program was not limited to just NSF sup- 
ported materials. 

In fiscal year 1^56, in response to teacher in- 
terest in receiving training on a part time basis 
during the school year, a program of In-Service 
Institutes was initiated. It had the whole range of 
objectives as stated above for the Summer In- 
stitutes. The major difference besides format was 
the glientele attracted by these In-Service In- 
stitutes. The Summer Institute and Academic 
Year Institute Programs generally recruited 
nationally and attracted as participants the - 
younger, better trained teachers. The In-Service 

.Institute participants were the older, less well- 
trained teachers who were unable to leave home 

; in order- to undertake a full-time program of 
study. 

Discussions concerning the advisability of 
providing training opportunities for elementary 
teachers began several years before formal es- 
tablishment of a program of summer and in- 
service institutes for these teachers in 1959, 
although there had been several experimental 
projects held before that time. It was believed 
that since most elementary school teachers did 
not teach science as such, a more realistic ap- 
proach might be through institutes for science 
supervisors in school systems where science is 
given considerable attention in grades up 
through seven. 

Every elementary school teacher was potent 
tially a science teacher/ since there was littleX 
departmentalization at/ the elementary level. \ 
Emphasis was therefore. placed on training key J 
teachers andsupervisors whomight be able toin- 
fluence others in their schools. It was also hoped 
that these teachers, along with their colleagues at 
the secondary level, would conduct in-service 
training in their local area for elementary per- 
sonnel. The elementary summer and in-service 
programs were not a major implementation 
device. They could not get a critical mass of 
teachers trained at one locale as a practical 
matter, and the program was terminated in fiscal 
year 1966 as new elementary curricula were 
beginning to become available. 

A Science Training Pfugram for High Ability 
Secondary School Students had centered its 
attentions on the needs of student participants. 
Some projects involved the introduction of 
materials from the program activities into the 
student's high school, which required the in- 
volvement of high school teachers. In 1961, this 
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became a separate program. The Cooperative 
College-School Science Progr'arn (CCSS) was 
seen by some institutions as an opportunity to 
•help ' introduce new course materials in 
mathematics or chemistry into areas of the coun- 
try where they had not yet taken hold. In fiscal 
year 1962. curriculum implementation appears 
as an element of the program. In fiscal year 1963, 
tvyo types of program activities were supported, 
those whose main function was working with 
high ability students as in previous years, and 
those which involved collaborative efforts of 
college scientists and secondary school systems 
in improving the secondary programs in science 
and mathematics. The essence of the program 
was the attempt by colleges, universities artd 
research institutions ' to work changes in high 
school science by a combination of precept and 
example. The earliest programs took place in the 
summer and on weekends during the academic 
year, were participant-centered, and their effects 
on school systems were transmitted through 
students and teachers, with students hopefully 
bringing a sense of need and urgency back to their 
schools while the teachers brought back answers 
to'that need. 

Several institutions devised CCSS programs 
with the immediate purpose of helping schools 
introduce new course material. In some of these 
the student participants played a role as 
demonstration classes for teacher retraining. In 
others, students were not included and in a few, 
the secondary teachers were eliminated as 
regular participants. A general consultative 
relationship was established between a college or 
university and a school system. 

With the termination of the summer and in- 
service institutes for elementary school teachers 
in 1966, this program became the sole vehicle 
supported by NSF for assisting elementary 
school personnel to receive training. The bulk of 
proposals concerning elementary levels received 
in 1968 and in later yearsiwere based on projects 
aimed at the implementation of NSF-supported 
curriculum materials. On theother hand, many of 
the secondary school proposals requested sup- 
port for non-NSF curricula and locally generated 
materials. For example, in fiscal year 1972, near- 
ly all the elementary grants involved the im- 
plementation of national curriculum materials, 
while less than half of the secondary grants were 
so oriented. 

In 1968, a program recommendation memoran- 



dum pointed out the need for supp^irltn^a..signifi 
cant number of projects in implementing elemeiT^ — ^ 
tary sciences. It pointed out that teachers were 
very poorly trained, usually with no science 
background at all. Traditional course con tent. had 
been so poor that students had practically no 
framework upon which to build mare 
sophisticated secondary school science content. 
Traditional sources of help available to elemen- 
tary schools for their elementary science 
curricula had been quite poor and had failed to do 
an adequate job up to this time. With new 
materials appearing it was essential that these 
new materials be introduced with intelligence 
and competence. 

It recommended that NSF provide substantial 
guidance on the kinds of training teachers should 
have as well as the kinds of persons who should 
be influential in training the teachers. An essen- 
tial element is feedback from the classroom to the 
training cadre particularly in the beginning of the 
implementation process. The thrust of the 
program, therefore,.was for NSF tosupport a suf- 
ficient number of exemplary programs in thi^ 
area. NSF wished to be able to implement some 
excellent and substantive course materials in 
elementary science while at the same time for- 
ming new bonds between the elementary s^chool 
system administration and competent stiience 
educators in the colleges. 

Beginning in 1969, the program sponsored a 
series of conferences to disseminate information 
about new curricular efforts. The emphasis was 
an orientation of college level sciencedepartrnent 
members and science educators capable of help- 
ing to disseminate the new course content 
materials and who were available to serve as con- 
sultants and project leaders for school systems 
which intended to implement the materials in 
their own classrooms. Extremely few 
scientifically-trained professionals with detailed 
knowledge of the content and approaches of the 
new science curricula were available to help in- 
troduce the new materials in a valid manner. This 
experimental program was subsequently sup- 
ported under the label of Administrators' Con- 
ferences ancf administered by the Course Content 
Improvment program. 

In 1966, it became apparent that several forces, 
mostly external to the Foundation, had combined 
to make it necessary to re-examine some of the 
operating assumptions at NSF with regard to 
curriculum implementation. An exploratory cori- 



fererice on implementatipn of science curriculum 
improvement in elementacy^cTtools was held at 
the University of Maryland Science Teaching 
Center in January, 1967. f he-impetus for the con- 
ference came from,the increasing recognition on 
the part of the Foundation staff that the develop- 
ment and availability of improved curriculum 
materials does not of itself guarantee improve- 
ment of science education in the classroom, es- 
pecially at the elementary level, nor is upgrading 
of teachers competence in subject matter suf- 
ficient to effect improvement even if it were 
possible to reach the million elementary school 
teachers with instruction in the severalscientific 
disciplines that tlie new elementary science 
curriculadrew on. Theconference explored, with 
a small group of people from selected elementary 
level course content improvement projects and 
science leaching centers, the development of 
mechanisms for more effective implementation 
of science education based on the current 
curriculum innovations. 
The conference suggested: 

(1) Orientation of t^he staff of existing courst; content im- 
provement projects to allow proiect involvement in im- 
plementalion activities to a greater extent than previously; 

(2) operation of training sessions with respective resource 
people. 

Suggestions included (a) involvement with one 
project in depth; (b) participants to include 
college facultyr curriculum specialists, other 
supervisory school personnel, teachers and prin- 
cipals, or teams of the above designed to affect 
local systems; (c) training periods of from 1 to 8 
weeks, the sponsorship by a number of agencies 
such as universities, science teaching centers, 
regional laboratories, (d)' elaboration of long- 
range plans fqr implementation activities. 

The Pre-CoUege Education in Science (PES) 
Annual Report for 1967 pointe^^out that the many 
programs undertaken to inriprove instruclion in 
science and mathematics in elementary and 
secondary schools had not succeeded to the 
deg^^ee lioped for and needed. The assessment 
was that these programs did not achieve the level 
of impact of which they ^re. capable largely 
because their efforts did not include effective 
procedures to bridge the gap between curriculum 
and innovation, under the leadership of scien- 
tists, and classroom instruction, under the. ad- 
ministration of school officials. 



Course materials had been developed with the 
collaboration cf specific schools' in thorough 
classroom trials of preliminary versions. In other 
respects, the work had proceeded outside the 
purview of school systems. The training of 
teachers to use new materials and approaches 
through institute programs had emphasized 
meeting the needs of the individual teacher rather 
than the needs of a specific school system's' 
program by the development of a corps of 
teachers. While this pattern of support enabled 
innovative individuals to do effective things 
without the necessity of having to collaborate 
with a system whose internal forces tended to 
perpetuate the status quo, it had not produced the 
widespread changes hoped for and needed in the 
classroom. In 1967, a number of grants were 
made for conference workshops to train resource 
people, in some cases as individuals, in other 
cases as Jteams, to advise and work with the 
schools and school systems interested in adop- 
ting new curriculum developments. The trainee^ 
were drawn from science educators in colleges^ 
and universities, from members of curriculum 
study groups, school superintendents, principals 
and teachers who had demonstrated interest in^ 
elementary science education. 

In fiscal year 1969, the purpose behind these 
grants, as describedin t^he PES annual report for 
that year, was to find a mechanism to insure the 
wide availability of higjaly qualified assistance 
to schools wishing to use materials, a mechanism 
not requiring a large continuing Foundation in- 
vestment, perpetuating the curriculum develop- 
ment group after their substantive work is done. 
The training opportunities were to be offered 
primarily those who could be expected to train 
others (muMiplier effect) rather than to thosq 
who would be involved only in teaching their 
own classes. In fiscal year 1970, a greater share of 
the course content improvement program went 
into this implementation activity recognizing 
that this type of project was important in assur- 
ing the successful- introduction of new materials I 
into schools through the training of a critical/ 
mass of resource personnel. Even .though there! 
was no restriction with regard to the use of nonj 
NSF materials in resource personnel workshops 
most of the projects supported through this 
program involved NSF-supported curriculum 
endeavors. I 

Foundation policy in this area, as in the area 6f 
commercial distribution and financial 

! 



arrangements, had been influenced by the 
necessity of avoiding the direct promotion .o£ 
school system adoption of material developed 
with Foundation support. The Foundation 
recognized that traditionally full responsibility 
for the selection of curricula in the U:S. rests with 
appropriate vlocal school authorities. Therefore, 
the Foundation has ^onsistejitly refused to 
provide funds for sales promotion and activities 
of a similar nature. On the other hand, with the 
increasing investment in curriculum materials, it 
has become more evident that the Foundation 
must accept some responsibility for assuring 
accepting and use of the materials. The Founda- 
tion has sought to. maintain a proper balance 
between these two somewhat competing con- 
siderations. 

As a result Foundation support for curriculum 
implementation has tended tp correspond more 
with the earlier stages of implementation. The 
paucity of individuals competent to assist 
--•schools and school systems in implementing in- 
novative curricula led the Foundation at an early 
date tp support leadership development projects 
involving training of resource personnel in par- 
ticular curricula. These personnel were theniable 
to Qssist local schools and school systems in in- ' 
^iroducing (at the latter's option) new instruc- 
tional materials by conducling dissemination 
and training activities. Prior to 1973, such 
leadership projects were funded through the NSF 
Course Content Improvement Program (which 
was primarily, concerned with curriculum 
development). ^ 

Support for curriculum implementation was, 
however, in the past dispersed through the 
various Education programs. One program 
which provided substantial support for im- 
plementation activities vyas the longstanding and 
well-known NSF Summer Institutes Program. 
The same was true of the In-Service Institutes 
Program. Proposing colleges and universities 
could submit proposals designed to assist 
schools and teachers in their areas in introducing 
new" curricular materials such as PSSC, BSCS, 
and^Chem Study. These activities involved later 
stages in the implementation process than did the 
leadership projects, but were still considered ap- 
propriate for Foundation support since the 
• decisions to use the materials had been made by 
the teachers' local schools. In some cases where 
close cooperation with a particular school system 



was deemed advisable proposals could be sub- 
mitted to the NSF Cooperative College-School 
Science Program. 

In all these programs unsolicited proposals 
were submitted by colleges, universities and ap- 
propriate nonprofit organizations. While the ex- 
tent of curriculum implementation supported 
was to a considerable extent a function of the 
proposals received, funding allocations and 
curricula priorities were determined on a year- 
by-year basis by the Foundation. At any one time 
a certain percentage of the activities supported 
by these programs could be identified with 
specific NSF-supported curricula. In 1965, for ex- 
ample, roughly 20 percent.pf the NSF Summer In- 
stitutes had a major orientation toward one of thei 
NSF-supported curricula; Grants were awarded 
to the host institutions' to support these ac- 
tivities. 

Except for those aspects of development which 
must overlap with implementation, such as infor- 
mation dissemination and leadership training, 
direct Foundation grant support for implementa- 
tion activities has not been provided to the 
grantee-developer of curriculum materials. For 
the most part such grantees have obtained sup^ 
port for implementation activities through other 
means. Frequently, publishing agreements for 
' NSF-supported materials provide for activities 
such as information dissemination and teS^cher 
training to . be performed by the grantee- 
developer at the publisher s expense. These ac- 
tivities supplement those supported directly by 
the Foundation. , 

In the past several years, partly in response to 
pressures from the Congress and the Office of 
Management and Budget, the Foundation has 
revamped and stepped up its implementation ef- 
forts. The Foundation has established a separate 
program of ^^.Instructional Improvement Im- 
plementation at the pre-college level which 
provides a sharper focus for curriculum im- 
plementation activities. The program is based on 
the premise that NSF can mpst effectively further 
utilization of curricula materials by supporting a 
few high-visibility models intended for a variety 
of learning situations. In the selection of 
materials for implementation the program 
emphasizes nationally recognized curricula, 
which includes but is not confined to materials 
developed with Foundation support. 
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National Science Board Involvement 



In the earliest years of the' Foundation, 
National Science Board approval of many ac- 
tivites, including science education, was provid- 
ed through consideration of the budget submis- 
sion and allocation for each year. Specific 
"Education in the Science" proposals were 
brought to the Board for approval only if they Ex- 
ceeded the Director's authority ($250,000. later 
$500»000). However, the Board did receive 
reports from the staff from time to time on both, 
the programs which were under way and the 
plans for developing new activities or launching 
experimental programs. For example, the Board 
followed closely and received presentations 
directly from the developers of the Physical 
Science Study Committee (PSSC). 

The first specific Board .involvement Was in 
1955 when the budget for science education was 
submitted recommending an allocation- for im- 
provement of science curricula and teaching 
training. At that time the Board asked "that 
primiiry consideration be given to the improve- 
ment of high school science curricula.. 

The Course Content Improvement (CCl) as a 
program element appeared in the budget in 1956 
but the Board's records do riot show that it was 
specifically approved or that guidelines were 
provided for it. ; 

During the next several years the NSB had the 
opportunity to discuss several proposals relating 
to curriculum development. In 1958, the NSB was 
advised of the assumption of responsibility by 
Education Services, Inc. (ESI) for the Physical 
Science Study\ Committee (PSSC) project. In 
1961, some concern was expressed as to the ad- 
visability of giving general overall support to ESI 
even though the PSSC had received high ratings. 

In 1961»,lhe NSB approved the CHEM Study 
grant;' and in 1962, approved support for the 
Association for the Advancement of Science 
(AAAS) project. In September 1963, the NSB ap- 
proved the first MACOS program: this was iden- 
tified as ESTs Social Science Program. The ter- 
minal grant for CHEM Study was also approved. 
' In January 1965, the Board reviewed and ap- 
proved the second MACOS proposal submitted 
to the Board, $1,829,903 for 20 tnonths to ESI for a 
Social Science Curriculum project (under the 
direction of lerome S. Bruner.) Prior to approval, 
the Board raised three questions: (1) Is a Board 
committee considering the proper distribution of 



total effort between science education activities 
and the support of basic research? The reply was 
that Committee I was considering short-range 
and Committee III long-range aspects. (2) To 
what extent is ESI financially dependent on 
NSF? The reply was that NSF, over 6 years, has 
. furnished a large total amount, varying in 
percentage annually. These sums support pro- 
jects, riot ESI as an organization, (3) Which 
organization benefits from sales under science 
education activity grantis? It varies! ESI 
segregates such income in a special account, and 
the portion constituting profit is returned to 
Treasury. . . Several Board Members spoke in 
favor of supporting the project on the grounds 
that a novel approach in- social sciences would 
stimulate otl.ers to undertake curriculum im- 
provement projects. , A third MACOS grant was 
approved in September, 1966 for $1,597,000 for 
two years. 

In September 1968 an award was approved for 
a "Social Sciences Curriculum Program" (SSCP) 
for $528,400 for one year to the successor of ESI, 
Educational Development Center, Inc. (EDC). 

In September 1972, ;the Programs Committee 
reviewed the fiscal year 1972 annual CCI report. 
Following the Committee's review and on its 
recommendation the Board approved 5 large 
. proposals including one from EDC "Exploring 
Human Nature" for $550,000 for one year./Fhe 
Programs Committee requested that these 
proposals include more information regarding 
reviews, salaries, etc., and expressed some con- 
cern Tor the progress of the entire program. This 
prompted thein to ask for an assessment of the 
future use of current materials being developed 
to determine whether the needs are being ade- 
quately filled. 

In September 1973 the Committee recommend- 
ed approval of a proposal for AAAS but raised 
numerous questions regarding one from EDC for 
"Unified Science and Mathematics for the 
Elementary Schools" (USMES) for $622,300. 
Subsequently, the staff withdrew the proposal in 
order to clarify certain litems (e.g., high travel 
costs) prior to Board considercition. This original 
request \va,^ for one year. This latter proposal 
was submitted again in October 1973. 

The Board^approved the resubmitted USMES 
proposal from EDC for $486,500 for 10 months. 
The minutes read as follows: . 
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ThisVevised USMES projecl was resubmitted by thestaff un- 
der direction of Dr. Paige. Continued support was propos- 
ed forltJSMES which has been developing interdisciplinary 
units based on real problem challenges to students, together 
with the materialst resources, teacher training, and 
organizational featuresmeeded for effective implementation. 
\Seven units are in progress; eight have been developed; ten 
\are in the planning stage.'The staff feels that the project is 
progressing well i&nd that, when 25 or 30 units are com pleted. . 
school districts or d commercial publisher will be interested 
iri the publication and distribution of these materials and the 
development of others. 

\^ In addition to approving selected proposals, 
\the NSB has oyer the years evidenced interest in 
ihe curriculum program. In November 1961 upon 
the advice of the Divisional Committee for 
Science Education, the Board supported the es- 
tablishment of a special committee under the 
American Association for the Advancement of 
ScienV (AAAS) to coordinate efforts to improve 
instructional materials. 

The ]9pard minutes for March 1963 indicate 
that therk was some concern over the high cost of 
Course Content Improvement (CCI) projects. 
Later that j/ear the Board in considering budget 
justifications, discussed an understanding 
betv/een NSF and the Office of Education clarify- - 
ing NSF's focus on CCI. 

In September 1963 while approving- the ter- 
minal grant for CHEM Study and the first 
MACOS proposal, the staff advised of the policy 
on royalty income: 

All grants being made in the Course Content Improvement 
Program which involve possible royalties from sales or ren- 
tals of fifif*^ provide that such "income" is to be placed in es- 
" croVv accounts to be used as directed by the'Foundation. Such 
funds may be required to be returned to the Foundation and 
. up to the amount of the grant, may be used for its general pur- 
poses* 

In connection with approval of several CCI 
' proposals the Board Members expressed concern 
regarding the stability and fiscal responsibility 
. of groups receiving CCI grants. Additional con- 
cern was voiced over whether these programs 
would offer balanced education. The statement 
was made that if ^SF is a large contributor to th6 
budgets for such groups it has more than usual 
fiscal responsibility concerning their status. 

In March 1965 the Board .Chairman asked that 
recommendations for future plans for the entire 
CCi program be submitted for detailed con- 



• 'fhe re-use of the funds was later declared to be illegal by 
^theGAOand the NSF practice was revised in November 1971. 



sideration by the Board. The minutes indicate 
that the Board Members welre in agreement that 
the Foiindation should reserve-the right at all 
times to terminate CCI projects and to avoid 
developing monopolies. In the discussion of a 
Biological Sciences Curriculum Study (BSCS) 
proposal which was approved at the meeting, 
caution was also expressed about imposing ar- 
bitrary rules limiting support to a fixed number 
of years on the ground that such a limitation 
could exclude certain desirable continuations or 
extensions of the programs. 

In May 1965 at the request of the Subcommittee 
on Science Research and Development of the 
House Committee on Science and Astronautics, 
the staff prepared for it and for the Board a 
"Status Report on the CCI Activities of the NSF.'' 
This was the first policy statement to be provided 
to the Board on this program. Relevant points in 
the statement were discussed and generally 
agreed upon in NSB Committee III (Memoran- 
dum of Discussion of the Fifth Meeting on May 5- 
6,. .1965 is on file). The Committee concluded that: 

1. CCI projects should be an initial venture to 
be transferred at a later date to outside 
groups; 

2. responsibility for stimulating and suppor- 
ting such a program resides in the Federal 
Government; and 

3. career curriculum improvement groups 
should be avoided. 

Committee III also suggested site vists by 
Board Members to aid in the formulation of an 
acceptable policy. (Subsequently*, several such 
site visits were made including one to. ESI in 
Cambridge, Mass.) 

During a discussion of the Course Content Im- , 
provement program in November 1965, the Board 
again reiterated previously expressed con- 
clusions; 

1. There should be developed no "special" 
corps of course content revisionists", but 
new people should become continually in- 
volved in these problems; and 

2. As a corollary, no group of people involved 
in course content activities should be en- 
couraged to perpetuate themselves. 

In an April 1966 discussion of the in- 
terrelationship of NSF with the newly formed 



33 



agency. Office of Education, it was agreed that' 
NSF's Course. Content Improvement program 
should be continued.. At this meeting it was 
reported' to the Committee that the Bureau of the 
Budget and the Off icjB of Science anc}Technology, 
. .favor continuing NSF participation in CCI 
activity because of their belief in the desirability 
of the type of approaches which the Foundation 
has used. . There was a general agreement that 
the Foundation should not withdraw from course 
improvement but that it should expect to be 
supplanted in someareasby theexpandedOEac- 
livity. 

In June of 1966 the Board requested for the first 
time that an annual review of the CCI program be 
presented to the Board as well as a block presen- 
tation of its programs to be funded and that this 
review and presentation should be provided to 
Committee III for consideration and the formula- 
tion of recommendations to the full Board for ac- 
tion. The first annual report on the CCI program 
was made to the Board in September 196iB: 

In February 1967 Committee III was informed 
that it was the policy of the Foundation to con- 
sider support of CCI activities up through a first 
revision of materials. After that time it was 
proposed that projects be placed in the "public 
domain" through the mechanism of free licensing. 
iFuture revisions could ihexi-'^be undertaken 
irrespective of the sources of support. 

Committee III was advised in September 1967, 
that funding for CCI projects was normally 
planned two years in advance. It was expected 
that as older projects were terminated funds 
would become available for new projects since 
there was no shortage of people interested in par- 
ticipation ;in this program. The second annual 
CCI report to the Board was also presented in 
September. Committee III reported to the full 
Board its detailed review of the program and ex- 
pressed its satisfaction with management and 
effectiveness. The Board approved continued 
support of the recommended programs. 

In January 1968, there was discussion of 
proposed programs to help disadvantaged 
students on several academic levels through 
various programs including CCI. Committee III 
endorsed this proposed venture within 
budgetary and statutory limitations. During the 
Committee's discussions it was pointed out that 
implementation of CCI programs is dependent 
■. upon administrative decisions at the local school 
system level. In March the Board agreed on 



general NSF policy for publication procedures, 
production and distribution of materials and in- ' * 
come utilization for CCI. (copy in file) 

Later in 1968 a Board Task Force on Science 
Education (a subset of the Programs Cqmrhittee).. 
reported that it had reviewed the CCI annual 
report, examined the programs carefully, and 
recommended that the Director be authorized to 
continue certain projects. 

The Task Force on Science Education con- 
sidered a paper (copy in file) concerning methods 
for evaluating NSF*s Curriculum Development 
Program. Discussion centered around the 
desirability of setting up and supporting a pro- 
ject to evaluate the various course cont^ent im- 
provement programs, including consideration of 
design for guidelines for the next generation of 
CCI materials. The concept of such a project 
which would involve an outside grantee or con- 
tractor was to be presented by the Task Force to 
the Programs Committee at its next meeting. 

In September 1970, the Board received its fifth 
annual summary of the CCI programs. The Ad- 
visory Committee for Science Education reported 
its findings and the Board Chairman reiterated 
support for NSF's educational activities and the 
hope that the Foundation would continue support 
especially at the pre-college level despite the for- 
mation of the new agency, the National Institute 
of Education. The Board asked its Long-Range 
Planning Committee and the NSF Executive 
Council to give priority to the development of a 
long-range plan for the support of science educa- 
tion. 

After the September 1971 meeting, the 
Programs Committee which had now been com- 
missioned to review on behalf of the Board the 
annual CCI report as well as all proposals under 
the program announced that it was satisfied with 
the status of the CCI program. The Programs 
Committee discussed with staff members exter- 
nal evaluations of the programs and posed^ 
several other questions concerning CCI all of 
which were satisfactorily resolved. In a report to 
the Board the Advisory Committee for Science 
Education stated the future of CCI was promising 
and it was one of NSF!s most important acr 
tivities. 

The Director informed the Board in November 
1971 of a revis^'d policy regarding disposition of 
income generated under education grants to 
become effective immediately. The following is 
excerpted from the minutes: 
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Incqme will be applied to offset costs of ^rant activities as 
welt as costs of administration o( the income-producing 
properties. When income is not expected to exceed $10,000, 

. ihe^granlee may keep and apply to research and education in 
the science amounts* remaining after .offsetting costs. 
However, any income remaining after payment of costs, 
which exceeds $10,000, will be remitted to the Foundation. 

^ Where total income is estimated to exceed $10,000. the grant 

. willprovidespecificallyfordispositionof income. Income not 
used as provided for in the grant will be remitted to the Foun- 

- dation. With respect to contracts, income received vyill nor- 
mally be applied to offset costs chargeable to the contract, 
.and gnxlhcome not so used shall be remitted to the Founda- 
tion. \ . .. 

In September 1973 the annual report of the. 
**NIat?rials and Instruction Development 
Program" (MID), formerly the Course Content 
Improvement Program, was presented .to the 
Program Committee. It stressed changes in the 
overall education program and how emphasis 
was shifting as a consequence, with the thrust 
being, toward modularization or delivering 
'^methods of education" rather than on *'tight 
course content." Questions were raised as to the 
level of current expenditures as compared to 
* earlier years and also about the ranking of 
schools in a, priority context. It was stated that 
expenditures were substantially lower, perhaps' 
by as much as one ijuarter as compared to six, 
^years ago, and that elementary school 
' mathematics would be high on the priority list for 
the next two or three years. The Committee in- 
dicated that there might be too much stress being 
placed rn mathematics and science curricula to 
the detriment of the social sciences. Actually, the 
bias had been the other way, but at the secondary 
rather than the elementary level. 

In October 1973, the Programs Committee dis- 
cussed a proposal from EDC. The record of that 
meeting includes the following: 

The AD/E indicated agreement with the recommendation of 
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the Board's Ad Hoc Committee on Science Education that the 
highest priority in science education be directed at "the 
development and maintenance of exceptional high quality 
doctoral and postdoctoral programs to produce the best basic 
and applied research talent in the country." He also shared the 
Committee's concern that there should be a close linkage 
between education and research. The ^ recommendations 
which the staff has made to meet Congressional requests for 
minimal graduate student support in the fiscal year 1974 are 
in line with these concerns. 

,The Committee and staff seem to be in 
reasonable agreement on the highest priority, 
and it is abundantly clear that the Committee did 
not imply that all available funds' should be 
obligated to these concerns. Science literacy re- 
quired more curriculum research and develop- 
ment. Here the question is **how";not '*why". Dr. 
Paige assured the Committee that he did not plan 
to squander available funds on dubious projects 
nor did he wish the Directorate to become^^theiln- 
spector General of a fullblown production opera- 
tion. However, he did believe the commitments to 
a project during the research and development 
stage must extend to the point where it could be 
stated that: '*Here is curriculum material that our 
evaluations indicate is responsive to national 
needs; it is different; it is in sufficient quality to 
be implemented today for your independent 
testing; and, if you find this material successful, 
we urge you to encourage commercial conceras to 
expand on NSF's pioneering efforts.*' 

In, September 1974, the Programs Committee 
received and discussed the MID annual report for 
fiscal year 1974. There were no special questions 
from the Committee. The Board also received the 
annual report with the notation that the principal 
thrusts in pre-college education at the elemen- 
tary level are for education for science literacy 
and for careers in science. During that year 56 
proposals were received and 43 grants were made 
tataling $8,211,021. 
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There has been regular interaction between the 
NSF staff and the Congress particularly in the 
annual appropriations hearings and, after the 
icvision of \he NSF Act in 1968, in authorization 
hearings as -well. There have also, been several 
oversight hearings and reports issued, including 
one on Science Education in the Schools of the 
United States in 1965. 

The Committee Reports of the early years 
typically contain few comments regarding 
programmatic activities, although the hearings 
contain much discussion on various aspects of 
the programs. It is House Report No. 1477 on the 
FY 1967 NSF Appropriations Bill that first makes 
any mention of the fact that the Foundation sup- 
ports the development of course materials for the 
teaching of science in primary and secondary 
schools. 

During the early years of hearings on the Foun- 
dation's appropriations, discussions relating to 
education dealt primarily with training of 
graduate students, although there were some 
references to the quality of faculty at the un- 
dergraduate level. 

During the hearings on the FY 1954 budget, in a 
discussion between Senator Magnuson and Dr. 
Waterman, the point was made that the lack of 
quality among secondary school teachers would 
have an effect on the production of scientists. 

The Foundation's budget presentation for FY 
1955 contained for the first time an explicit entry 
dealing with education in the sciences. This ac- 
tivity, included summer institutes for college 
teachers, a program of research opportunities for. 
college teachers during the summer, and the 
beginnings of an education in-the sciences sup- 
port activity at the secondary school level. The 
primary emphasis, however, both in the budget 
and in the discussion during the hearings was 
still on the gi^duate fellowship program. 

In a summary statement^submitted for. the 
record in the FY 1956 hearings, the section 
•'Education in the Sciences" included, for the first 
time in a. Congressional hearing, a specific need 
for improvemehf.of science curricula. 

For. the next several years the need for im- 
provipg capabilities of secondary school teachers 
and content of courses was discussed in the Ap- 
propriation hearings. The degree of control or 
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authority that the Foundation should have over 
the course of science in the country was a consis- 
tent matter of concern. On January 30, 1956, Dr. 
Waterman stated, "Our whole setup, thoroughly 
endorsed by the Board, is Such that we do not 
attempt to exercise control of science, but rather 
by use of the guidance of leading experts in the 
different fields of science, we find from them the 
direction in yvhich science should move. This 
gives us the /basis then on which we pir n our 
programs. It/is a method which has proven very 
successful."/ 

During the hearings on the FY 1957 budget 
Congressn^an Albert Thomas, Chairman of the 
House Ap,()ropriations Sub-committee put forth 
"several /suggestions which indicated a 
willingness on the part of the committee to ex- 
pand high school teacher training programs. The ' 
indications were that Thomas believed it wiser to 
spend /money on educational programs rather 
than dn equipment for basic research or policy 
studies. Because of the emphasis on high school 
programs, NSF was asked if it could use $10 
million more for high school teacher training. 
When it became clear that the source of the a^d- 
ditional money would be. other NSF non- 
education programs, the offer was . declined. 
However, the Appropriation Act for FY 1957 in- 
cluded a "limitation clause": 
/ " . 

' Provided, that. . .not less than $9,500,000 shall be available 
for tuition, jjrants, and allowances in connection With a 
program of supplementary training for high school science 
and mathematics teachers. . . , . ' 

While the Senate recommended deleting it, this 
limitation, in varying amounts and minor 
changes in wording, remained in NSF appropria- 
tio\i language through the FY 1973 appropriation. 

The FY 1958 budget was the first in which 
funds were requested for curriculum develop- 
ment. The appropriation subcommittee was ad- 
vised that support would be given to efforts to 
improve course content and presentation of 
material by revision of course outlines by 
regional conferences of teachers, administrators, 
educators, and scientists, to discuss means for 
improving courses, and by the development of 
modern teaching aids of particularly high quali- 
ty. Concern was evidenced for the competency of 



high school teachers. Dr. Waterman stated. "Our 
position in the Foundation is that, if there is any 
way possible, this should be done in the 
traditional way. by the local mechanisms— the 
conimunities. the school boards, and the States. liF 
they are convinced that this Problem is acute and 
needs attention, they can tlake the right steps 
more simply and I think most effectively. But. my 
personal opinion is that we see that something is 
done—hopefully that it can he done locally. That 
is the way, but it seems to be the Federal Govern- 
ment-must be in the position to stand behind this 
whole thing and see that action is taken.'* 

During the FY 1957 hearings in a discussion of 
the need for stimulation of students' interest in 
science at the pre-college level. Mr. Boland had 
suggested that stimulation should go back 
beyond the high school to the grammar school 
level. In the hefarings for FY 1958, in a discussion 
with Dr. Bronk, then Chairman of the National 
Science Board, of children learning mathematics. 
Mr. Boland stated. **I think you have to go beyond 
the high schools. I think you should go into the 
grammar schools^and make mathematics attrac- 
tive there." 

, During hearings before the Subcommittee of 
the Committee on Appropriations. United States 
Senate. 85th Congress, Second Session, May 12. 
1958. on the FY 1959 budget. Dr. Waterman 
stated to Senator Magnuson, "Secondly, we need 
quality in training. We must insist upon that.. 
This means superior teaching and superior 
teachers together with the equipment and 
materials that they must have." When talking 
about the education programs, Senator 
Magnuson asked. "In some cases the States have 
requested the Science Foundation to go into this 
field even to the extent of revising the curriculum 
in high schools, but you only do that upon re- 
quest." Dr. Waterman, "That is right." Senator ^ 
Magnuson. "You do not interfere unless they ask 
you to interfere.?" Dr. Waterman, "No, we do no' 
interfere. You see this characterizes our program. 
We get the requests. Then we analyze and we 
select the best ones (proposals) so our program 
continues to be selective." Senator Ellender ask- 
ed if NSF work is solely related to science and 
was told; "Solely to science." The Senator later 
staled:'^"Today*s students all aim for the easiest 
way out. and I do not know of a better thing that 
this Foundation could do than to help to 
reestablish secondary school systems. It is then 
that we should give our students the proper train- 
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ing because it is from there that you gel scien- 
tists." 

In the hearings on the FY 1960 request before 
the Subcommitte of the Committee on Ap- 
propriations of the House, 86th Congress. First 
Session, in a discussion regarding the authority 
of the Foundation to improve elementary and 
high school curricula. Mr. Jonas indicated that 
his interpretation of the Act is that the Founda- 
tion has a broad authority tostrengthen curricula 
and stated, "I do not see anything in the Act, as I 
recall it, that would prevent your working with 
the State school authorities in an effort to 
strengthen local curriculum." 

Later in the discussionJvlr. Thomas also stated 
that. "The language of the Act is broad enough to 
do practically anything you want to. Now it is a 
question of what you do in connection with the 
Department bf HEW and others and where you 
are overlapping. Now if you did not have the. 
Department of HEW, you could do anything you 
want to under it (the Act). Is that not a 
reasonably accurate statement?)) Dr. Waterman 
replied, "I would suppose so." Mr. Jonas then 
stated,' "That section 3(a)(1) is open-ended I 
think. I do not see why you would have any dif- 
ficulty doing what I have suggested under that 
very first authority." 

During the hearings on the appropriation for 
FY 1961 Congressqian Thomas after extensive 
discussion of the Course Content Improvement 
Program expressed the opinion that "It is the best 
part of your program." 

There was a discussion of royalties expected to 
be received. The publication of materials financ- 
ed by NSF was also discussed and assurance 
given that no individual profits from this activi- 
ty. 

The hearings on FY 1962 focused on the costs of 
a Course Content Improvement Project, the cost 
of a textbook, how it would be distributed, and 
the fact that it must make its own way. 

The Hearings for FY's 1963 and FY 1964 con- 
tain little in the way of substantive discussion on 
the Course Content Programs. 

In the helarings before the Subcommittee of the 
House Committee on Appropriations on the FY 
1965 budget most of the statements concerning 
the Course Content Program came from NSF. In 
his testimony. Dr. Bronk stated, "I would stress 
the following as being the most significant func- 
tion of the National Science Foundation: to train 
peopliB to.be able to deal with what is going to be 



required of them but cannot be anticipated; and 
i to develop understanding of what is already 
known' and to discover new knowledge for the 
development of our country/' 

Df. Handler, a member of the National Science 
Board stated "There is in this document (the 
budget document for FY 1965) an expression of 
what Harvey Brooks of the National Science 
Board . called the social invention. It is a 
remarkable one. This is a Course Content Im- 
provement Program. I must confess when I first 
heard of it I took a rather dim view. I have tc 
apologize." Mr. Thomas asked, **This is Dr. 
Zacharias' project?" Dr. Handler replied, "Yes. 
He invented something not merely the program 
itself. . .1 t^hought this was an enormous amount 
of money to spend "bn. . .a few textbooks and 
teaching materials. It could not have been done 
. any other way. . .it makes the best of man's 
endeavors available to the whole population." 

**The policy framework within which the 
science education programs operate require (1) 
that they supplement rather than replace 
traditional forms of support; (2) that no measure 
of control is assumed over the processes of educa- 
tion; (3) that the fullest involvement, cooperation 
and advice of the scientific-educational com- 
munity is obtained; and (4) the improvements are 
sought rather than massive support of those *nor- 
mal' and existing activities which may tend to 
perpetuate unsatisfactory educational practices 
and results." 

i Congressman Thomas was particularly in- 
terested in the question of how long it would be 
necessary to continue to improve course 
materials. The answer was that there would be a 
peak of activity in each of the disciplines, with 
some small updating effort. A list of projects was 

"to be inserted in the record. 

; During the Se^nate Hearings on the FY 1965 
budget. Senator Allot raised the issue of the use 
if education materials developed with NSF sup- 
port. He was concerned that the support of 
curriculum projects by the government would 
jforce the use of these curricula. He does not want 
jto have^theBe things rammeddown the throats of 
; educators.'* The response was that the techniques 

^ the NSF has adopted would not likely evolve in 

I that way. Senator Allot also questioned the role 
of NSF cooperating with the Office of Education 
in developing..^a curriculum in Social Sciences. 

■ Senator Allot asked, "Is the National Science 
Foundation cooperating, with the Office of Educa- 
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tion in developing a curriculum in social sciences^ 
or in areas other than the natural sciences?" Dr. 
Riecken replied, "No, ^ir...We are not at. the mor 
ment cooperating with the Office of Education on 
curriculum development in the social sciences.** 
Senator Allot, "Are you working on curriculums 
in this area without the cooperation of the Office 
of Education?'* Dr. Riecken, "We are supporting 
twQ projects — I think one by the American 
Anthropological Association and one by the 
American Sociological Association for the 
development of high school curriculum 
materials. There is no attempt to enforce the use^ 
of these materials in any school system." Senator 
Allot, "How will they b» published and by 
whom?" Dr. Riecken, "At the present I'm not com- 
pletely clear. In the . past we have assisted 
publication in several different ways. A prime 
example of one way is the textbooks prepared by 
the Biological Sciences Curriculum Study which 
have just been published in three different ver- 
sions." 

Senator Allot later asked, '*Can we get the 
answer clear then that they are not preparing a 
curriculum in the social sciences?" Dr. Riecken 
says, "We are assisting profiessional associations 
in preparing curriculum material which may or . 
may not be adopted by the secondary schools. 
They are publicly available but not imposed on 
any school." 

Hearings were held by the Subcojnmittee on 
Science, ReseaccJi, andDeyelopnieji^of the Com- 
mittee on Science and Astronautics, House of 
Representatives, in 1965 to review NSF. Included 
was. a discussion of science education. These 
hearings were repoHed on in early 1966,^ and 
were to be the basis for the 1968 amendments to 
the NSF Act of 1950. While there were no specific 
recommendations on science education, two per- 
tinent observations were made, one dealing with 
teacher training, the other with support of new. 
curricula. NSF was given credit for improving 
teacher training in the sciences; the issue was, 
could the job be done more effectively, NSF 
should learn more about possible methods. 
Credit-was also given for progress in curricula 
improvement; the issue had to do with the ap- 
parent small number of professional groups in- 
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volved. The thrust was for more competition in 
the field of curriculum development. 

Early in 1965 the Committee on'' Science and 
Astronauti.es issued a report prepared for it by 
the NSF on Science Education in the Schools of 
the United States. This report traced the 
historical events and conditions that led to the 
status of science education at that time. It raised 
issues for public debate on such problems as 
**how much Science Education," improvement— a 
never ending task, investment in science educa- 
tion, and general scientific literacy. 

The bill to amend the National Science Founda- 
tion Act of 1950 was discussed at Hearings before 
the Subcommitte on Science, Research and 
Development of the ^Committee on Science and 
Astronautics, House of Representatives, 89th 
Congress, Second Session, April 19, 1966. 

The question of NSF's role in the social 
sciences was raised. Dr. Haworth in his 
testimony says, ** Although the Foundation has 
for some years,;conduc(ed limited but growing 
programs in support of certain aspects of the 
social sciences, it is widely felt that the time has 
come for these sciences to receive expanded 
attention from the Foundation, and it is fitting 
that the social sciences should now be recognized 
by that name in the Act itself rather than receive 
support anonymously as an "other science." He 
goes on to say that "this greater visibility should 
emphasize the efforts of the Foundation to 
stimulate and support increased research and ifh- 
prove education in the social sciences in order to 
help them play an increasingly important role in 
coping with some of the major problems facing 
sucioty today." 

The 1968 Amendments to the NSF Act of 1950 
added the social sciences to the list of specific 
sciences the NSF is authorized and directed to 
support. 

During the next several budget hearing.% the 
Course Content Improvement Program was dis- 
cussed. In FY 1966 budget hearings, Mr. Boland 
had commented that the appropriations subcom- 
mittee has encouraged NSF to work at the lower 
grade levels. Mr. Jonas asked, "You will run into 
trouble on social sciences with this won't you?" 
Dr. Riecken replied, "The kind of social science 
mliterials being produced' under our grants are 
not, I think, likely to be as much trouble as the 
biologists have had over evolution," Mr, Jonas, 
"The leading article on the front page of the Wall 
Sired Journal this morning indicates a little trou- 



ble brewing in that field right now on account of 
some revisions. of social science textbooks." Mr. 
Boland, "On the social sciences the material you , 
are preparing. . .wouldn't produce a lot of con- 
troversy, isn't that so?" Dr. Riecken, "That is 
right." Mr. Jonas inserted material from the 
budget document showing the request for 
elementary and junior high school studies and 
secondary school studies including material in 
. the social sciences. 

In the FY 1967 hearings, the National Science 
Board guidelines were discussed as were the 
^ mechanics and techniques of Course Content Im- 
provement. The NSF point was that it did not per- 
mit Federal funds to be used for promotional pur- 
poses, and commercial versions of the material 
had be competitive witli others in the market. 

In the discussion of the FY 1968-budget for the 
Cooperative College-School Science Program, 
Congressman Talcott asked, "Is this an effort to 
direct the thought of these teachers or control the 
philosophy of Ihe teachers?"^ Dr. Fontaine 
responded, "No, not in any way.-' He went on to 
say that, "The^'school system is the one that 
makes the decisions and the Foundation assists 
the college or university to work with the school 
systems in the introduction of the materials that 
the' school system wishes to introduce." Mr. 
Evins stated, "There has been a lot of concern to' 
have the local people involved rather than having 
direction and dictation on the guidelines from the 
Office of Education." Mr, Boland, "You are mak- 
ing an effort to upgrade the quality of science on 
the local level by this cooperative program," 

In discussing the course content improvement 
program, Mr. Talcott asked about principles of 
economics that are to be taught. Dr, Kelson 
responded, "The school system chooses the par- 
ticular approach, presumably because it fits into 
liie schools overall education program." Mr, 
Talcott asked, "You are not suggesting the 
philosophy or system of economics that is being 
taught or put into the textbook. This is a local op- 
tion of the school district?" Dr. Kelson replied, 
"Yes." 

The House of Representatives Report No. 259, 
90th Congress on the Independent Offices and 
Department of Housing and Urban Development 
Appropriation Bill, 1968 carried a paragraph 
regarding the limitation language on supplemen- 
tary education for high school math and science 
teacher.s (the institutes programs). It stated: 
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-^grants are awarded to teachers to enable them to obtain 
further proficiency in their designated fields. This has proven 
to be one of the most successful programs of the Foundation. 
The committee is not recommending the reduction as propos- 
ed in the budget, nor the change in emphasis that the budget 
suggests for the pr^ogram. The committee on a number of oc- 
casions has earmarked funds in excess of the budget for this 
purpose and is of the opinion that a cohtinuing.need exists for 
these institutes. 

The committee position was sustained in the 
appropriation act 

In the Authpriz^ion Hearings for FY. 1970, in 
during discusiiorisY^ith Congressman Daddario 
on the training of te)achers, NSF advised that it 
was placing more attention and stress on im- 
plementation, bringing the secondary school 
.teachers into contact with new materials. 

House of Representatives Report No. 91-288, 
"91st Congress, First Session, Authorizing Ap- 
propriations to the National Science Foundation, 
June 5, 1969, included references to science 
education in its explanat\on of the Bill. The report 
devoted fourteen pages to science education in 
general and specifically discusses the budget 
presentation program by program. There was 
mention that **an increasingly important aspect 
of the program is support for the training of 
■ iriBSOurce personnel able to implement the new 
curriculums in local school systems." When dis- 
cussing the Institutes activity, the report stated 
that **the projected program will stress the train- 
ing of leadership through advanced studies and 
the implementation of local curricular improve- 
ment through training to teach the newly 
developed course content." It also spoke of efforts 
to improve school science curricula and discuss- 
ed in detail the Cooperative College School 
Science Program and its efforts to focus on the 
improvement needs of local schools and school 
.districts. ^ 

The report of the Committee on Labor and 
Public Welfare, United States Senate Report No. 
91-285, 91st Congress, First Session, National 
Science Foundation Act Amendment of 1969 to 
Authorize Appropriations, July 2, 1969, discuss- 
ed co.yrse content improvement and speaks of 
"implementation projects which have done much 
to alleviate the critical stress on the system of 
pre-coUege education." The report stated that it 
wishes to emphasize the importance it attaches to 
the Foundation's continuing to maintain effective 
coordination regarding its education programs 
with the Department of Health,. Education, and 
Welfare. i a 



In the NSF FY 1971 House Authori2;ation Hear- 
ing, February 17, 1970, it was pointed out that 
curriculum development had been a powerful 
force for educational improvement. It was clear 
that the utilization of these resources wauld be 
neither widespread nor in many instances well 
done without judiciously placed assistance, both 
financial and professional. Therefore, about 
1966, the Foundation initiated programs to help 
with the implementation of new courses, 
materials and methods! Mr. Daddario stated, 
'*Give them the advice they need to develop the 
programs that would in fact trulyifit their needs 
and this is the relationship you are talking 
about?" Dr. Fontaine replied, "yIbs, and let me 
stress, the* teachers would come not as in- 
dividuals, but as participants with the full con- 
currence of the school system sd that there would 



^ be a direct relationship between 
the training and the needs of the 



the purpose of 
school." 

subcommittee 



0 

39 



In testimony before the specia. 
on the NSF of the Committee on Labor and Public 
Welfare, United States Senate, 91S^t Congress, Se- 
cond Session on the NSF, authorization for FY 
1971, the Director, NSF 'was questioned by 
Senator Kennedy on social science teacher 
programs. The response was that social sciences 
were covered in the institute programs and effort 
was being devoted to the development of 
curriculum materials; about 10 percent of the 
science education budget contributed to social 
sciences. The differences in handling of history 
and social sciences was noted with the comment, 
**It is a difficult area for us to sort out, but we are 
trying to be as. helpful as vye can within what we 
consider our legislative mandate." 

In House of Representatives Report No. 92-204, 
92nd Congress, First Session Authorizing Ap- 
propriations to the National Science Foundation, 
May 17, 1971, there is a description of the 
emphasis being placed upon *'relevant teaching 
programs and curricula (increasingly teacher in- 
stitutes, especially for high school teachers are 
being related explicitly to the efforts .of school 
systems to ^dopt new teaching programs which 
entail teacher restraining)." The report states 
that, "In substance the programs are -being 
modified extensively to develop leadership per- 
sonnel in the hope that there will be less need for 
Federal funds and professional assistance from 
outside the schools themselves." 

The report also says that substantial effort is 
devoted to training teachers in the use of new 



material^ iand instructional programs, a type of 
^activity essential in Uie effective im^ 
of curricula in 'the schools. Under the heading, 
eqiirse and : Curriculum Development and Im- 
plenieiitation Activities, the report describes 
makiiig available to sbhools innovative and im- 
pr6y€Mi4eaching matexials and techniques which 
local Vschools have neither the funds nor the 
scholarly expertise to generate themselves. 
/The report stated that the Committee is con- 
cerned about maintaining and increasing the' 
quality of teaching and research at all levels 
rather than the quantity of new scientists being 
produced. In speaking to the precollege level in- 
stitutes, the report states that **the NSF can' more 
effectively introduce revised curricula at the pre- 
college \eyel since new courses and revised 
teaching mfethods are no better than the trained 
personnel charged with implementing them. 

The Senate report No. 92-232. 92nd Congress, 
1st session on the FY 19/2 authorization made a 
substantial increase over the NSF budget amount 
for Science Education support. The action was 
taken based on the stated belief that "these 
programs have had a very beneficial impact on 
the quality of science education in the United 
States.*' The action taken is "considered 
necessary to provide for the maintenance of 
quality science education in the United States." 
Among the programs cited were pre-college 
teacher institutes and de velopmen t of new course' 
material, courses, and curricula for use at all 
levels. 

The committee went on to state it believed 
there would be, over the long term, increased de- 
mand for science and engineering professionals; 
it would not-bfi "in the best injerest^of the Nation 
to make precipit^usj:ed«€trdns in science educa- 
tion and institutional science support programs 
of NSF in order to compensate for short-term 
fluctuations in the employment market.** 

In the House Appropriations Hearings as in the 
House Authorization Committee Hearings, Dr. 
McElroy had spoken to the need to develop new 
introductory courses in science organizedaround 
societal problems rather than by traditional dis- 
ciplinary approaches. He als6 spoke of the 
program for implementation of curriculum 
development projects. In the discussion of the 
education programs, Dr. McElroy discussed with 
Congressman Giaimo the fact that in terms of in- 
novative curricula NSF had not deemphasized 
that activity nor the development of the per- 



sonnel to carry out those curricula. 

The House of Representatives Report 92-305, 
92nd Congress, 1st Session, on the FY 1972 ap- 
propriation bill referred to Science Education 
Support with the comment that the committee ex-' 
pects that funds included for that purpose will 
not be diverted to other purposes. The Senate 
Report (No. 92-264) voted a not-less-than amount 
for science education support. 

House of Representatives Report No. 91-1060, 
91st Congress, Second Session, Independent Of- 
fices and Department of Housing and Urban 
Development Appropriation Bill, 1971. May 7. 
1970, made a reference to programs". . .updating 
the subject matter and instructional competence 
of teachers. The Summer Institutes Program has 
.been particularly useful in disseminating new 
i^eas to. a broad base of teachers that are im- 
mediately used in teaching students throughout 
the coiintry.*' Senate Report No. 91-949. 91st Con- 
gress, Second Session, Independent Offices and 
Department of Housing and Urban Development 
Appropriation Bill, 1971. June 24, 1970, speaks 
only of earmarking funds for Summer institutes. 
They (the Senate) prefer instead to "leave the 
funding of programs to the better judgment of the 
Director and his assistants.** 

During t^e hearings before the Committee on 
Science and Astronautics an?l the Subcommittee 
on Science, Research, and Development, House of 
Representatives. 92nd Congress, First Session, 
on the FY 1972authorization, Dr. Herbert Carter, 
Chairman of the National Science Board, made 
reference to graduate education in the sciences 
and was questioned by Mr. Mosher on his 
"limited emphasis.'* Dr. Carter responded. "The 
health of science in this country cannot be main- 
tained without the general support/and proper 
education for all levels.'* Congres^rnan Mosher 
agreed and went on to observe that we have to 
start with the primary grades and establish a 
solid base. 

At a second hearing. March. 23, 1971, in his 
opening statement. Dr. McElroy noted that the 
education program teacher institutes would be 
designed to concentrate specifically upon in- 
dividual school system requirements. In a dis- 
cussion of criteria for determining priorities in 
the science education programs. Dr. Humphreys 
told Congressman Davis that one of the options 
that the Foundation had provided for in its FY 
1972 budget was the development of introduc- 
tory courses in science that are organized around 
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■social, problem rather than by the traditional 
disciplinary approach. Dr. Humphreys' prepared 
statement discussed the pre-college level 
curriculum development and implementation ac- 
tiyities and specifically mentions: Man; A Course 
of Study. He also discussed the future use of in- 
stitutes as a mechanism for involving curriculum 
supervisors, principals, etc., in the implementa- 
tion process. ^ 
' At the NSF FY 1973 House Authorization 
Hearings . the Director's opening statement 
stated, "We will continue to support teacher 
training projects in an attempt to build a 
capability for improving science programs at the 
pre-college level by training key personnel in the 
management techniques and mechanics of in- 
troducing new course materials." The Instruc- 
tional Improvement Implenrientation Program 
designed to aid in the implementation of new 
curriculum materials in elementary and secon- 
dary school classrooms was discussed in detail. 
^ In the FY 1973 House Appropriations Hearings 
duHng the discussion of the science education 
program between Congressman Talcott and Dr. 
Kelson there was an explanation of the need to 
train teachers in handling the new curificula that 
are now being installed in the elementary and 
secondary school classrooms. In the discussion 
of the science education improvement program,, 
Dr. Kelson stated that, **We have found that once 
you have supported the research and develop- 
ment of new programs such as the curriculum 
and the new way of teaching science education, 
the use of these programs doesn't just happen all 
on its own. Therefore, the second part of our 
program is to help the school system to actually 
put into practice these new approaches to in- 
struction." Congressman Giaimo discussed 
development and implementation and the fact 
thatif does not duplicate HEW interests. 

At the Senate Appropriations Hearings for that 
same year. Dr. Stever in his prepared statement 
- stated that, "We plan to train key personnel in- 
cluding administrators#and teachers, not only in 
subject matter but also in techniques of handling 
new science course materials which are of direct 
interest to them." In materials submitted for the 
record, it was stated that explicit programs for 
. impjementation are also necessary and that the 
Foundation's program of Instructional lmprove- 
ment Implementation attempts to foster and 
promote the implementation of eduction reform. 

Other than descriptive material on the program 



" there were no comments regarding the pre-- 
college science education program in the reports 
from all the committees. 

In the FY 1974 House Authorization Hearings, 
the curriculum development activities under 
Careers and under Science Literacy were describ- 
ed. Most of the discussion during these hearings, 
however, was on the level of support for science 
education improvement requested by the Ad- 
ministration rather than the programmatic ef- 
forts themselves. \ 

In the House Appropriation Hearings for FY 
1974 the section of the budge.t dociwnent covering 
Science Education Improvement was inserted in 
the record. Concerning this material, Con- 
gressman Roush asked about the summer in- 
stitutes program and Dr. Kelson noted that the 
Foundation will* be devoting relatively more 
attention to helping teachers effectively use the 
new teaching programs. Congressman Roush in- 
quired into the redirection of the Science Educa- 
tion Improvement program and the discussion 
revolved around the role of 0MB in this redirecr 
tion. 

In the House of Representatives Report No. 93- 
284, 93rd, Congress, First Session, Authorizing 
Appropriations to the National Science Founda- 
tion, June 14, 1973, the science education im- 
provement program was explained. This was the 
first year that the breakout between Careers, 
Literacy, Effectiveness, and Problem Assess- 
ment was used. The implementation of new 
courses and materials was discussed. The Com- 
^mittee discussed the selective withholding 
carried out in the prior fiscal year by the Ad- 
ministration. The Committee restated its strong 
interest in the program of science education and 
emphasized NSF's responsibility for science 
education under its Organic Act of 1950. 

t^e Senate Report No. 93-2^5, 93rd Congress, 
First Session, National Science Foundation 
Authorization Act of 1974, ]une.28, 1973, stated 
that the Foundation's request for science educa- 
tion improvement was inadequate but makes no 
more detailed comment. 

At the FY 1975 NSF House Authorization 
Hearings, the implementation of newer 
curriculum materials is stated to be as important 
as the original development. The Foundation will 
continue to seek effective ways to help school ad- 
ministrators, teachers, and school systems with 
this problem. 

At the FY 1975 Appropriations Hearings it was 
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noted that the Foundation was concerned in that 
the new curriculum materials were not being im- 
plemented and that therefore the teacher training 
activities were being reoriented to assist in the 
adaptation and adoption of curriculum materials. 

The House of Representatives Report No. 93- 
995, 93rd Congress, Second Session, Authorizing 
Appropriations to the National Science Founda- 
tion, April 15, 1974, in Committee Views, men- 
tions science education with a rationale for in- 
creasing the amount requested by the Ad- 
ministration but there were no comments perti- 
nent to pre^college activity. 

Senate Report No. 93-848. 93rd Congress, Se- 
cond Session, National Science Foundation 
Authorization Act of 1975, May 15, 1974, urged 
two efforts in science education improvement: (1) 
ethnic minorities and women and (2) strong sup- 
port for programs designed to improve the quali- 
ty and effectiveness of science teachers at the 
elementary and secondary school levels. The 
Comrq^ittee stated that **the Foundation should 
take the necessary steps to reestablish and main- 
tain Summer Institutes specifically designed to 



enhance the subject matter competence of 
teachers." 

Tho Committee dons not aKreo with the position taken by the 
Foundation that Summer Institutes aimed al up^radinK the 
science sulVject mailer proficiency of teachers can now he 
phased out. 

As can be seen, interaction between NSF and 
the Congress was mainly in an authorization and 
budget context. Much of the material contained 
in the hearings has been taken from annual 
budget documents or has been additional 
material prepared by the NSF in response to re- 
quests from the committees. The pre-college 
science education activities have been supported 
as demonstrated by the general acceptance of 
budget levels and in some instances by specific 
limitations and. budget increases. Many areas of 
concern were discussed over the years. Advice 
and guidance from individual members of Con- 
gress and in the official reports of committees 
attest to a continuing keen interest in ensuring 
that an effective and appropriate effort is carried 
out in pre-college science education. 



Overview of Present Practices 



INTRODUCTION 

The National Science Foundation currently 
supports a. variety of activities for improving 
education in science, mathematics and social 
science. At the elementary and secondary school 
levels the Foundation's activities are now 
oriented towards two gpneral goals: 1) the 
development of science literacy, that is, im- 
pro.ving the capacity of children to understand 
the concepts and applications of science and their 
implications; and 2) the improvement of educa- 
tion for those likely to choose careers in ^icience. 
The current set of activities has evolved over a 
period ofyears as the science education environ- 
ment changed, as the national perception of needs 
for scientists and engineers was revised, and as it 



bocame-tilearer that an understanding of science 
and tec^hnolngy by all citizens vyjis crucial to the 
economic, social and political processes of the na- 
tion. 

Changes made in NSF curriculum development 
and implementation programs during the late 
1960s and early 1970 s, particularly with respect 
to what critics call "marketing" or "promotion" of 
curricula developed with NSF support, reflected 
the guidance of the Executive Office of the Presi- 
dent. While NSF support for basic and applied 
research was substantially increased, the NSF 
Institutional Development programs were phas- 
ed out and science education programs decreased 
in level and revised in content. The important 
theme during this period was the need to increase 
effectiveness. 
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The pressure for revision is indicated by the 
budget levels which dropped from $120 million in 
FY 1970 to $61 million in FY 1973; (See table 5). 
Increases made in support for fellowships and 
traineeships were opposed by both the National 
Science Board and tHe Congress. Similar cuts , 
made in. support for training instftutes for pre- 
bollege teachers were also opposed by the Con- 
gress. 

I Table I (items 2 & 3) shows the level of NSF in- 
volvement in^: large scale pre-college teacher 
training activities since the late 1950^6. While the 
earliest institutes emphasized subject maitter 
training, later ones included aspects of 
pedagogical techniques and familiarization, with 
new courses. By 1970 training for new instruc- 
tional programs as well as implementation of 
these programs Were included as program ac- 
tivities to be supported. ^ 

After FY 1970 funds for teacher training ac- 
tivities were substantially reduced from about-' 
$40 million to about $17 million in fiscal years 
1973 and 1974. Concurrent with this reduction, 
emphasis was placed on training for implementa- 
tion' of new courses and then mainly on the im- 
plementation of courses which might have 
widespread impact, such as those developed with 
NSF support. Thus in 1975 over 80 percent of 
such activities are aimed at getting courses and 
materials developed with NSF support into use in 
the schools. This is a reversal of the situation two 
or three years before whenless than 30 percent of 
the implementation activities inyolved such 
courses. _ 

This change was n^t construed as a massive 
implementation or marketing program, since 
only a fraction of a per cent of U.S. schools could 
be reached in any year due to the large size of pre- 
college eduqalion in the U.S., since the training 
programs were designed by the grantee, and 
since the institutes include many nbn-NSF 
courses. 

• NSFs initial FY 1972 budget request to the Of- 
fice of Management and Budget (0MB) of $33.3 
million for high school teachers was cut to $17.0. 
Course Content Improvement for elementary and 
secondary schools, the program for development 
of new courses, was uncut. ($11.2 million). The 
NSF Director then requested an increase in 
"Institutes" to $23.3 million. This increase was 
allowed by 0MB witli the stipulation that NSF 
introduce new criteria for selection of par- 
ticipants in the program. Such criteria should re-^i 



quire the teachers' ischool systems to assist thf*^ 
teachers in introducing the material derived from 
the Institutes into their instruction programs, 
and help improve the effectiveness of this 
program. This was explained in the NSF FY 1972 
Budget to Congress as follows: - 

Finally, many institute projects will be directly related to the 
new curricula and course 'material interests of school, 
systems. Teacher participation in these projects will be con- 
tingent on the endorsement of the teacher's institution to in- 
sure that there will be maximum opportunity for introducing ' 
improved science instruction programs in the school. 

General guidelines suggested by 0MB were to 
reduce the emphasis on support of individuals 
and increase emphasis on educational innovation 
and.productivity. The NSF response was stated 
in the introduction to "Summer Institutes for. 
Secondary School Teachers of Science and 
Mathematics, 1972" as included in the Summer 
Institutes Directory issued in December 1971. 

Many secondary schools and school systems have begun to 
implement important changes ih their science or mathematics 
programs or are seriously considering doing so. The principal 
objective of the National Science Foundation's Summer In- 
stitutes for Secondary-School Teachers is that of providing to 
teachers in such Schools training and information which will 
enable them to help their schools, to the maximum extent 
possible, efftct those constructive changes. Therefore 
applicants toaninstitute will be expected to indicate explicit- 
ly how their participation would relate to educational 
developments in their schools, and that statement must be en- 
dorsed by a local school authority. It should be noted that this 
constitutes a significant departure from thie earlier NSF 
Summer Institute program objective of up-dating the subject- 
mat tur knowledge of teachers as individual professionals. 

The 0MB guidance resulted in a study to 
develop objectives, criteria, specific programs, 
cost estimates, etc. The resulting report was a 
major effort involving interaction with both 
0MB and the Office of Science and Technology, it 
covered six main topics: Problems, Roadblocks, 
Federal and NSF Roles, Criteria (for program), 
NSF Objectives, and Proposed NSF Programs. 

Issues raised in this report concerning plans 
for curriculum included: 

• The strategy for developing new or in- 
novative curricula, e.g. will the emphasis on 
- local curriculum development for higher 
education programs be continued or will an 
effort be made to develop curricula for 
application nationally? 



44 



• action to be taken to encourage the 
publishing industry to support major 
curriculum development projects; 

• redirection of Teacher Institutes to help ac- 
ccmiplish broader program goals, such as in- 
novative, curricula, changing the in- 
stitutional arrangertients or improving 
productivity.' 

OMB indicated that additional detailed plan- 
ning was needed prior to final apportionment of 
funds, but approved the overall thrust of the 
presentaftion for inclusion in the President's 
budget. 

Prior to formulating the FY 1974 budget an 
NSF/OST Task Force Study of NSF education 
programs was undertaken. Though a fprmal 
report was not issued the draft Working Paper 
was, as intended, an important input into the FY 
1974 Budget. 

The report recommended a shift in emphasis 
from science education to prepare re^search scien- 
tists tq science education to prepare students for 
the wider range of occupations that demand a 
scientific or technical background and to in-, 
crease the science literacy of the population as a 
whole. 

The report's recommendations on NSF- 
supported teacher activities resulted in large part 
from consciousness of high and increasing costs . 
of education. The only teacher training activities 
recommended in the report are those associated 
with implementation of the course materials to be 
developed. 

The FY 1974 Budget to the Congress stated: 

Personnel . rtioricntiHinn nntl si:h()()l inipltinuMitnlion not 
directly relnled ti) now upprnnchtis dt'volopod with Voundn- 
tion support will ho. uliminated. tjxr.tjpt that iu:tivitit;s in- 
volving material.s iljjvtdoptjd thrcuij^h mei:hanisins nthor than 
NSF apnnsorud uTforls may bt? supported provided that 
thorouKh evaluation of the effectlvonuss of the materials is 
available anil clearly demonstrates that they can make a 
significant contribution to the atlainnuml of the program ac- 
tivities. 

The substantial revisions of the NSF Education 
programs were explained to the Congress in con- 
nection with the FY 1972-1974 budgets. The 
emphasis on use of teacher training, short 
courses for supervisors, and for implementation 
of new course materials was one of a number of 
changes and was' presented in the formal budget 
documents, inonltiontnl in statements and dis- 
cussed particularly with th(i Mouse subcom- 



mittees, as the official NSF position. 

As demonstrated the concerns for increasing 
impact and effectiveness and controlling costs by 
the Executive Office . of the President led to 
significant changes in the program. The relating 
of teacher training and similar activities to im-, 
plementation of new (bourses, particularly those 
developed with NSF support, was only one of 
these. 

The problems faced by any program in 
strengthening science education at the pre- 
coliege level are evident by the fact that IfThere 
are some 50 million students in grades 
kindergarten through twelve, ranging in ages 
from 5 to 18 years with rural, suburban, and in- 
nercity backgrounds. Not all are science oriented, 
nor are all college bound. 2) There are 1.3 million 
elementary school teachers and 400,000 secon- 
dary school science teachers. 3) Credentials vary 
from state to state. There are some 17,000 school 
districts with close to 2 million classrooms; and 
there are many, many varieties of State or 
government control. 

Since students in elementary grades rarely. 
make career choices at that level, and it would be 
unrealistic to speak of science-oriented.students 
in these grades, course materials, curricula and 
instructional strategies must be directed at all 
students. There are multi-year curricula; there 
are attempts to unify science and mathematics; 
adoption practices ior materials vary between 
Slate and local school options; and there are 
many intricaTe relationships between local 
school boards, district science supervisors. State 
boards of education, and Federally prescribed 
State commissions. It has become apparent that 
materials and instructional strategies appear to 
be the best leverage points to be used in pre- 
coUege science education. There are, therefore, 
two principal aspects of the'current pre-coUege 
education in science programs: (1) materials 
development, testing and evaluation; and (2) in- 
structional improvement implementation. 



Materials and Instructional 
Development 

I'he objectives of this program as stated in a re- 
ct^nt (;in'(l(; for Pr(;/)(irn(ion of Proposols ond Pin- 
jcr.t Oiw.rution are to encourage 
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scientists and science educators to carry out projects for the 
improvement of pre-college education in mathematics, the 
sciences, and social sciences. The initiative for undertaking 
projects should arise from a recognition on the part of scicn- 
Msts and educators that a non-trivial problem exists with 
respect to education in scientific disciplines or a qurriciilum 
area with an important component of science content, and a 
>villingnes8 to help solve the problem. An essential condition 
of any such undertaking is a substantial commitment of time . 
and. effort by scientists distinguished as teachers and in- 
vestigators in the disciplines (or problem areas) concerned. 

The program is concerned with projects that 
are designed for a broad ability range of students 
not only those oriented toward science careers; 
interdisciplinary in nature, particularly those 
that involve the social sciences; relate science 
and technology to environmental and societal 
problems: involve application of innovative 
educational techpologies; and projects that in- 
volve experimentation with new structures and 
procedures in science education. The model 
process followed to carry out these efforts is 
shown schematically in fig 1. An individual 
proposal may not follow exactly the sequence 
shown. / 

The first planned step in the development of a 
project is a/needs identification and assessment. 
A need for a Materials and Instruction Develop- 
ment Pro/ect may be identified in one of three 
ways: First, based upon a litprature search or 
other survey not sponsored or supported by NSF, 
an unsolicited proposal may be submitted to un- 
dertake a materials andjnstruction development. 
Included in this proposal would be an identifica- 
tion of needs and an assessment of th'ose needs. In 
this sense, the formal need or problem assess- 
ment step is not undertaken; Second, theFounda- 
tion may receive a proposal to hold one or more 
conferences to specifically assess a perceived 
need. Support may be requested solely from NSF 
or from NSF and other agencies. NSF staff may or 
may not pa.-^ticipate.in the conference, and NSF 
may or may not be requested to suggest 
attendees. The conferences may have been 
suggested by NSF or may be the result of an un- 
solicited proposal; Third, NSF may formally 
suggest an area for study and call for proposals. 
NSF requires that attendance at these con- 
ferences include a diverse group of participants 
from a particular scientific discipline, science 
education community, science education 
developers, and user communities, both ad- 
ministrative and teaching. A report is required 
which would make recommendations as how to 



respond to the particular need if a need was iden- 
tified. Reports are to be disseminated, both selec- 
tively and in journals within the education and 
appropriate discipline-oriented communities. 
The conferences may recommend su^lementing/ 
existing techniques or developing new ones; th^ 
may suggest new instructional strategies, or they 
may recommend development of complete new 
curricula. 

The Foundation Guide for Preparation of 
Proposals and Projett Operation for Materials 
and Instruction Development outlines the 
categories the Foundation will consider for the 
establishment of projects. It defines the scope, 
the eligible organizations and the eligible fields 
for which proposals will be accepted. This docu- 
ment is not considered a solicitation, but is a 
public indication of areas of interest to NSF. 
Proposals received by NSF are generally un- 
solicited, although there may be some instances 
of solicited proposals. Participants in a needs 
conference may and usually do submit a 
proposal. (Usually, a conference participant who 
submits a proposal has a better chance of success 
than a non-participant.) 

The proposals are generally based upon 
available needs assessments, either developed 
through the conference mechanism or through 
other sources. They are reviewed by NSF staff 
and by outside reviewers. Siie visits by both staff 
and outside reviewers may be carried out. In 
reviewing proposals, among the criteria used, are 
the likelihood of the impact on the community of 
a successful development and consideration of 
non-NSF sources as potential ,sponsors. These 
are in addition to the normal criteria of scientific 
merit, the competence of investigators, and 
others. The program staff also develops a priority 
ranking for a proposal. 

Outside reviewers are used extensively. The 
intent is to obtain a representative spread of in- 
terest, so that for any particular proposal there 
may be a mix of curricular developer, science 
educator, discfpline-oriented reviewer, teacher 
or administrator at school level as a participant 
in the review process. There may be from six to 
twelve reviewers on each proposal. While 
geoj^raphical distribution is considered in the 
overall group of reveiwers for all proposals, it is 
not a critoron for the seli!ction of reviewers for in- 
dividual proposals'. 

Upon receipt of comments from reviewers the 
program staff assesses the reviews aiid their im- 
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pact on a proposal. Where appropriate thfey relay 
back to the proposal writer a paraphrasing of 
reviewer comments, particularly in those cases 
where changes may be made in a proposal which 
has potential for success. In other instances, they 
may reject the review after careful consideration 
of the background of the reviewer, misunderstan- 
ding of the proposal or the significance of the i 
review. After staff determinations of priority, 
and a tentative decision to make an award, the 
level of effort and a budget for the proposal are 
then negotiated. 

During this process, proposals may be 
withdrawn by the proposer and in many in- 
stances where it is clear that the proposal will be 
denied, the proposer is offered the opportunity to 
withdraw. (There is a general belief that denial of 
a proposal will be detrimental to the chances of 
success with future proposals:) Proposals thai 
are denied are signed off at the division director 
level. rApprovals require the signature of the 
Assistant Director for Education. 

Upon approval, the project director undertakes 
a formal selection process to develop his project 
staff team (NSF may advise on the staff) and to 
establish his business procedures. Although it is 
not usually a requirement of the grant, an ad- 
visory board is established. NSF exercises over- 
sight of membership of this board. Since all 
development projects require a demonstration, 
selection of a trial center or centers is made. With 
the advisory board in place, the objectives of the 
project are sharpened, topics are redefined as 
necessary, and the pedagogical approach and 
wirters are selected. NSF may advise in almost 
any of these phases. 

The next general phas£ is writing. With the 
topics selected, the writing teams produce and 
revise materials until they are adequate to try in 
classroom. Revisions made after trial may use 
student guidance as a formulation mechanism. 

In the formative evaluation phase, a pretest is 
administered; if appropriate, with test materials 
used in a classroom. Both the project staff and 
NSF may have oversight. After the pretest is ad- 
ministered the project staff analyzes and 
evaluates the results to determine whether ornot 
revisions are needed. If they are, the cycle is 
repeated. If they are not, then the projecf is ready 
for publishing. 

If revision is necessary, writers (not necessari- 
ly, the primary authors) revise the mattvrial in 
response to the formative evaluation results. A 



decision is then made whether additional for- 
mative evaluation is needed. NSF then enters into 
the process. If it is needed, the previous steps are 
followed. Completion of therevision then leads to 
the publication phase. 

Although schematically the publication phase 
would appear to begin at the end of the revision 
sequence, appropriate publication arrangements 
can be made\at any point in the cycle. The 
developer submits to NS.F proposed procedures 
for notifying potential publishers of the 
availability and nature, of the niaterials. The 
Foundation has the responsibility for approving 
or disapproving these procedures. The developer 
proceeds to the point of receiving and evaluating 
proposals from publishers and makes a tentative 
selection of a publisher. The Foundation is then 
asked to either approve or disapprove. The 
grantee and the publisher with NSF consultation 
negotiate a publication-contract. Again theFoun- 
dation has the right to approve or disapprove.- 
The contact is signed between the developer and 
the publisher. Although NSF has participated irl^ 
the development of the contract, it is not a party 
to the contract. In the event equipment is re- 
quired, similar arrangements are made either on 
a contract or subcontract basis between the 
developer and a manufacturer. 

It should be noted that during this entire 
process the NSF staff has certain responsibilities 
for monitoring the program. The program 
manager should make site visits, should be in 
constant contact with the developer-r-inay- use 
consultants to review efforts and, depending 
upon the nature of the project, progress reports 
may be issued. Due to thedifficulties in obtaining 
staff time, site visits may be scheduled, to a 
developer depending upon the size of the project 
only every 12-18 months. Substantive reviews 
are generally carried out only when additional 
funds are to be allocated to the development proj- 
ect. Since many of these projects are of major 
size, they may be referred to the National Science 
Board for review and approval. 

The Secondary School Program in the budget 
element increasing Effectiveness of Educational 
Processes is directed toward providing secon- 
dary school students the best possible founda- 
tion forscience or technology related careers. The 
objectives include development of course 
materials attractive to a significant fraction of 
the enrollment and fostering the acquisition of 
problem-solving skills rather than providing 
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training for specific jobs. Tor those students who 
plan to go to college, support is provided for the 
development of course materials whijch present 
alternatives to conventional discipline-oriented 
curricula to be presented in flexible format ap- 
propriate fbr individualized study. A major effort 
under way is the Individualized Science Instruc- 
tional System — a sequenced, multidisciplinary 
course 'for grades 10 through 12. organized 
around topics of intrinsic student interests. It 
consists of highly flexible, independent modules, 
each requiring two or three weeks of classroom 
time. 

Work is progressing on a medical inter- 
disciplinary curriculum project for 11th and 12th 
grade students preparing for careers in the health 
fields, and resource and teacher centers are 
planned to aid in the dissemination and im- 
plementation of new mathematics and science 
materials. Under way also are some junior high 
level math6matics projects which provide alter- 
natives to current mathematics programs and are 
aimed specifically at applications in 
mathematics to science and technology. 

In the secondary school student component of 
the Student Orig'inated Projects, th€ Foundation 
plans to supplement, wherever possible, local or 
regional resources, and, by the use of Federal 
funds, to extend to more students special oppor- 
tunities for independent study in science. It is ex- 
pected that about 105 projects involving some 
4,500 students at more than 3,500 high schools 
will be undertaken during FY 1976. and some 
money will be used to continue experimentation 
with a variety of projects designed to test ways to 
introduce project-centered instruction in the high 
school setting. 

The elementary school program included in the 
Improv^ement of Education for Science Literacy 
Budget is designed to introduce into the school 
expertly-developed and tested classroom ac-^ 
tivities which will stimulate the interest of 
elementary school students in science and 
mathematics. The two principal components of 
program support are (1) development and testing 
of materials and instructional strategies attrac- 
tive to young children which will encourage 
learning and which will increase their basic 
knowledge, and (2) systematic implementation 
efforts to assure that the materials which have 



been developed are used effectively in the 
classroom. . 

Two development projects in mathematics 
stemming from a series of study conferences on 
the status of mathematics curricula in schools are 
currently evolving slowly with considerable 
attention being paid to research results in 
mathematics learning. There has been a com- 
prehensive analysis of mathematics 
achievements results initiated by the Conference 
Board of the Mathematical Sciences. There is en- 
couragement of locally-supported inservice 
orientation of teachers in content and- instruc- 
tion al strategies for new science and 
mathematics materials. 

Assessment and evaluation of barriers to the 
implementation df course materials and the ac- 
cumulation of data on the usage of NSF- 
supported materials is under way. Planned pro- 
jects include an interdisciplinary 
(mathematics/science) problem-oriented course 
which requires active participation by students, 
research in the learning of mathematics concepts" 
and skills, studies of the impact of newlyv.^ 
developed ..curriculum materials in classroom/ 
situations, and the development of materials ana 
strategies for alternative patterns of education/ 
The Secondary School Program will tes|t 
teaching materials and strategies, assist in tne 
dissemination of information about newjly 
developed 'curricula to decisionmakers at the 
State and local levels; assist colleges and univer- 
sities to participate with school systems in 
cooperative implementation projects and 
broaden the base of individuals other tman 
curriculum developers having skills needed in 
the implementation of specific materials. Efforts 
such as the development of a modularized, multi- 
disciplinary high school science curriculum and 
related teaching materials, a- sequential irter- 
disciplinary human science course for the middle 
grades, and an interdisciplinary political sciimce 
based curriculum, and materials and strategies 
for alternative patterns of education will be con- 
tinued. \ 

A new junior high level mathematics course 
and supplementary materials for use in existing 
courses on energy-related topics and recent fin- 
dings on the structure and dynamics of thie 
earth's surfaces is to be started in FY 1976. l.„ 



49 



Instructional Improvement 
Implementation Practices 

The development of curricula materials is not 
in itself sufficient to assure utilization. Creators 
of new educational materials generally begin to 
provide information about their activities to 
engender an awareness of product availability as 
part of the development process and in prepara- 
tion for field testing, shortly after they have 
proceeded to write trial materials. Information 
may be provided in terms of newsletters, 
professional society presentations,...and other 
ways; it is necessary to development and is a 
preliminary step to implementation. Implemen- 
tation will include dissemination of information 
to school system decisionmakers about new and 
recently released curriculum projects; develop- 
ment of resource personnel among leaders with 
responsibility for initiating in-service education; 
orientation of influential teachers in new 
materials; and intensive implementation of new 
materials in a significant number of classrooms 
within a school system by cooperative projects 
with near-by colleges or universities. 

Early implementation may begin shortly after 
the, formative evaluation. This is particularly 
true where there is field testing and trial use of 
materials. Full scale implementation will begin 
just about thesame^ime that thedecision is made 
to publish; late impj^ementation may take place 
after the materials lare available in published 
form» and new users as identified, 'r 

Through its Guide foV Pnipanition of Proposcils 
and Operations of Projects for Instructional Im- 
provement ImplemtJJitation Grants. The Founda- 
tion invites proposals for projects designed to im- 
plement major curriculum and course 
developments at the pre-college level. The im- 
plementation process encompases dissemination 
of information ai)()ut, and adoption of new 
educational materials and techniques. Im- 
plementation emotivities vary. 

A first, stage of the process is to create 
awareness, that is, to disseminate information 
about materials to curriculum decisionmakers; 
conferences are the usual method. This may be 
followed by activities designedlo develop an in- 
terest in the materials by training of resource per- 
sonnel. Utilization aad trial on a preliminary 
basis permits potential users to examine the 
characteristics of the materials and for in- 
dividual teachers to become familiar with it. 



-^"With school systems' adoption, implementation . 
activities then focus on orientation for key 
teachers who are to use the materials with a 
critical number of students. 

Administratively, implementation projects are, 
grouped into three categories: (1) Leadership 
specialist projects - designed for specialized 
educational personnel such as master teachers, 
department' heads, principals, supervisors, 
college faculty. State Department of eduqation 
staff members, superintendents,- curriculum 
directors, and others who influence curriculuhi 
decisions and lead implementation efforts. These 
leadership projects assume a variety of forms. 
Some are designed primarily as information con- 
ferences to acquaint school administrators with 
one or more of the new curricula, their 
characteristics and costs in order to provide a 
basis for informed decisionmaking. iDthers 
provide an opportunity for study of specific 
curricula and prepare participants to assist their 
colleagues and other educators in installing these 
curricula in their schools. 

Grants in support of the leadership specialist 
projects provide funds to cover instructional 
costs and assist participants in meeting expenses 
associated with their participation, such as roon\, 
board and travel. The participant funds repre- 
sent a contribution toward enabling individuals 
to take part in a project, and these funds may or 
may not cover the full cost of participation. 

2) Ttiaclier projects - designed to bring about 
classroom change or improvement through effec- 
tive tetrt:her utilization of new instructional 
materiafs or practices. Because of the large 
numbec- of elementary teachers (1.3 million) 
proposals for elementary teacher projects must 
have the promise of large impapf potential due to 
built-in multiplier factors for provision of in- 
struction to a large number of teachers at low cost 
such as through the application of educational' 
technology. Elementary and secondary projects 
are designed to prepare teacher participants to 
teach new curricula materials effectively and to 
be able to assist their colleagues and other 
educators in introducing new curricular 
materials into their classrooms. Projects assume 
a variety of formats. Many have a summer phase 
lasting from two \o eight weeks. There are 
follow-up meetings during the subsequent school 
year. A few projects are conducted solely during 
the academic year. Funds are provided to cover 
instructional costs and to assist participants in 
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meeting expenses associated with their par- 
ticipation, such as room, board and travel. 
vT?) school system.'pro/ects - directed at bringing 
about specified curridulum or course changes or 
improvements in classro(ims through the direct 
cooperation of colleges and universities and/or 
school systems willing lo commit funds, per- 
sonnfel and other resources in effecting these 
changes. Here the expectation is that a school 
system will have committed itself to the improve- 
ment, but needs help In bringing it into their 
school system. 

System project plans may vary and include 
elements found in leadership specialist or 
teacher-centered projects. Typically, the plan re- 
quires a commitment of the school system and 
associated colleges to utilize specific national 
curricula, summer and/or academic^year training 
in requisite subject matter and^ appropriate 
teaching techniques, marshalling of resources 
from within and beyond the schools that will 
guarantee unsuccessful implementation, and 
development of leadership and allocation of 
resources to assure continued expansion and 
maintenance of the program beyond the funding 
period. 

' Funds will be provided to cover instructional 
costs and to assist participants in meeting ex- 
penses . associated with their participation. 
Design of school system projects requires a detail 
plan involving funds, personnel, materials or 
other resources that will guarcintee effective 
utilization of the national curricula in a 
classroom targeted for implementation. 

Proposals are generally submitted on an un- 
solicited basis to this program. Guidelines are 
provided as mentioned earlier. These guidelines 
have been distributed to all school systems with 
an enrollment of over 10,000, supervisors of 
mathematics, science and social science listed in 
the U.S. Registry of junior and senior Kigh school 
teaching personnel, directors of current projects, 
individuals whose proposals were denied in 
earlier competitions, and individuals who have 
asked that guidelines be sent to them. The 
program utilizes a peer review system for the 
determination of proposal merit. 

An ad hoc panel to review these proposals is 
used with a large number of panelists (about 185 
in Fy 75). Panelists are selected from scientists, 
science elducators, knowled^^eable cla«5sroom 
teachers and school system administrators. Con- 
sideration is given in the selection of rovievvnrs to 



their geographical or institutional representa- 
tion, their experience, the content of the 
proposals as related to panelist background, and 
prior experience (or its lack) in the review 
process. .An attempt is made to match panelist's 
qualifications to proposal content. Each proposal 
is read by two panels of six individuals with the 
expectation that panelists would provide com- 
ments of a helpful nature in addition torating the 
proposal. The proposals are also reviewed by 
staff. As highly meritorious proposals are iden- 
tified they are immediately , negotiated barring 
the existence of any specific problem. Lower 
ranking proposals are discussed among the staff.. 
These frequently require substantive negotiation 
to improve the proposal before award is 
recommended. 

Upon recommendation' of a grant and the ap- 
proval of the 'Assistant Dilrector for Education 
awards are made and a directory is prepared 
listing all approved projects. 

Director's meetings are held on a geographic 
basisj The agenda for these meetings is con- 
structed to accommodate the needs of both school 
personnel and project directors and to provide an 
opportunity for the sharing of views which will 
contribute to the improvement of projects. 
Special information sessions dealing with NSF 
curricula have become an important feature of all 
these director's meetings. Project directors dis- 
cuss project management, reporting procedures 
and general problems; school personnel consider 
means for greater involvement in the copduct of 
the projects; NSF staff presents data on grants 
and information on program goals, objectives 
and priorities. This latter serves as one of the 
ways in which NSF can influence^ the mix of 
proposals to be received in future years. 

Each project director is required to submit an 
interim report at the conclusion of the summer 
phase and after the close of each major other than 
final, phase. Final repoxts are required following 
the conclusion of the project. Site visits also lake 
place duringmonitoring, but only a small number 
.of project sites are visited in any one year. 

Schematically, figure 2 attempts to show at 
'what time implementation activity starts. This is 
not an attempt to show a flow of activity. Figure 3 
traces NSF involvement. 

Implementation will include dissemination of 
information to school system decisionmakers 
about new and recently released curriculum pro- 
jects, development of resource personnel among 



51 

64 




OWaOPMENT 
IMPeOJTATION 




POST 

OEVELOPM 
PHASE 




FIRST INSTRUCTIONALIMIERIALS 
' EARLY IMPLEMENIATION 



INFORMATION 
ACTIVITIES 




ERIC 




OOSlMPOT 




TRAINING OF 
RESOURCE PERSONNEL 



INFORMATION 
ACTIVITIES 



CLASSROOM 
USE 



SCHOOL SYSTEM USE 



FINAL MATERI.US 
AVAILABLE 



INFORMATION 
ACTIVITIES 



•TRAINING OF 
RESOURCE PERSONNEL 



I 



SCHOOL SYSTEM 
ORIENTATION 



TEACHER. 
ORIENTATION 



TRAIN CRITICAL MASS 




TRAIN INDIVIDUALS 








1 








V 


CLASS 
USE 




MULTIPLIER 
EFFECT 




SINGLE TEACHER' 
USE . 




WIDE 
ADOPTION 



MAINTENANCE BY 
local/in SERVICE 



REVISED COMMERCIAL 
EDITION(S) ' 







SCHOOL SYSTEM 
ORIENTATION , 




' TEACHER 
ORIENTATION 



0/D 75-1279 
5-75 . 



NSF INVOLVEMENT IN CURRICULUM IMPLEMENTATION 



PREPARE PROPOSAL GUIDELINES 



NEGOTIATIONS 



■GRANT 



MEET WITH DIRECTORS 



I 



POSSIBLE STAFF VISIT 



REPORTS FROM DIRECTORS 



CLOSE OUT 



I 

RECEI VE PROPOSALS 

I 

PEER REVIEW • 



STAFF REVIEW 



DECLINATION 

~1 — 

FEEDBACK REASONS FOR DENIAL, 
AS REQUESTED 



O/D 75-1281 ^ 
' 5-75 



leaders with responsibility for initiating in- 
service education, orientation of influential 
teachers in new materials, and intonsive im- 
plementation of new materials in a significant 
number of classrooms within a school system by 
cooperative projects with near-by colleges or un- 
iversities. 

" The bulk of this work will be done under the 
auspices of local school systems, since there are 
far too many school classrooms for NSF to reach 
directly. NSF will encourage the development of 
coVnpetent resource personnel and assist in the 
introduction of new materials in a sufficient 
number 'o ft'u all b n s"vv i tli" en ouglT v i s ili il i t y to 
gain favorable attelntion and simultaneously 
develop models or standards for implementation 
activities. 



^ Summary ^ 

What has been described above is principally a 
process which leads to the development of new 
instructional material and its implementation. 
There are, of course, some obvious overlaps 
between the two processes, and in niany in- 
stances it is difficult to sort out what is develop- 
mient"* and what is implementation. There has 
been a long history of concern with effective 
utilization of curriculum materials — not only 
those developed with Foundation support, but 
those developed without NSF stipport. Founda- 
tion procedures and policies in both areas have 
tended to evolve over the years as described in 
the historical presentation. Policy in these areas 
has been influenced by the necessity to avoid 
direct promotion of school system adoption of 



materials developed with Foundation support. 
Yet, in the discharge of its mission of improving 
science education, NSF has accepted the necessi- 
ty for encouraging the effective use of quality 
classroom materials and practices. The Founda- 
tion has recognized thaf tradifibnarU^^ 
places full responsibility for the selection of 
curricula on the appropriate local school 
authorities. 

As the Foundation's investment in curriculum 
materials has grown, pressures have grown for 
the Foundation to accept some responsibility for 
assuring that the materials have an opportunity 
to gain acceptance by potentiaTusers. The Foun- 
dation does support, the development of new in- 
structional materials, innovative methods and, 
where necessary, equipment. While it oversees 
arrangements for the publication of curriGulum 
materials it does not enter into the financial 
procedures between the developer and the 
publisher. 

The Foundation does support certain types of 
implementation activities directed toward 
awareness of existing curriculum materials, both 
NSF and nori-NSF, the training of individual 
teachers to effectively use these materials, and 
will assist'school systems in installing these new 
materials and methods— but only to the point of 
providing expertise and training in their use. 

The Foundation serves as a catalyst in 
stimulating irfiprovement in many different 
school environments. Since it cannot support 
17,000 school districts, it attempts to ineet 
diverse needs by providing multiple access to im- 
provements without being prescriptive or con- 
trolling. The purpose is to provide standards and 
examples which aire highly visible. 
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Publication Policy and Financial Arrangements 



Before February 1969» NSF did not have any 
formal policy approved by the NSB on commer- 
cial distribution or income resulting from sale of 
Inaterials developed under science education 
programs funded by NSF. Until then the f)oIicy 
was esisentially set by an NSF memorandum to 
the senior staff from Dr. Waterman on 
copyrights, ^ased on this, internal procedures 
were established within the Education Direc- 
torate in the early 1960's. In essence, this 
memorandum- stated that all relevant factors 
must be taken into consideration before an agree- 
ment could be reached on arrangements for 
copyright and distribution and that undue 
governmental interference was to be'avoided in 
the course of normal competitive private enter- 
prise; that where the publication would be made 
by an educational institution oruniversity press, 
Consideration should be given to profits being 
used to promote the general purposes of the grant 
or contract. Further, **in all cases, care should be 
taken toavoid financial advantage accruing toin- 
dividuals through privileged use of materials or 
manuscripts having received Foundation sup- 
port.** Later, specific provisions were contained 
in individual grants or curriculum development 
projects, A sample clause in use in 1962 follows: 

1. Arrangements for cuinmercial production of 
properties developed under/ this grant 
should be such as to permit a number of ap- 
propriate and interested concerns tosubmit 
proposals for production and distribution. 

Selection of manufacturers, publishers, and 
distributors shall be made so as to assure 
wide distribution at a reasonable price. 

The Foundation' is to be informed as to the 
plan upon which negotiations shall be bas- 
ed, including the companies to be ap- 
• proached, measures to assure that qualified 
concerns will have an opportunity to submit 
proposals for production and distribution 
and criteria to be ised in selecting the 
successful bidder(s). 

AH agreements entered into by the grantee 
providing for the use or distribution of 
books, films, patents, copyrights or other 
properties conceived or developed under 
this grant must be reviewed and approved 
' by the Foundation prior to signature by the 
. grantee. 



2. Income derived from rents or royalties, or 
from the sale of books, films, patents or 
other property rights conceived or 
developed under this grant shall be placed 
in a separate account by the grantee and 

, shall be utilized in ways approved or deter- 
mined by the Foundation. ,. 

3. Recognizing that trajditional American 
^ policy places responsibility for the selection 

of subject matter used in the schools in the 
hands of appropriate school authorities; 
public and private, the Foundation desires 
that the funds made available under this 
grant to^be restricted in their use to the 
development of new instructional programs 
and materials and to the dissernination of 
information about them. 

4. The grantee agrees that the Government 
may use, reproduce, or have reproduced and 
used, for Government purposes, all 
materials developed by the grantee in con- 
nection with this grant. 

This type of clause evidenced the Foundation's 
intent to control the commercial publication of 
grant materials including the notification to the 
trade of the availability of materials, and ap- 
proval of selection of the publisher and the 
publishing agreement. 

An attempt was made to redefine the publica- 
tion policy in November 1963. The draft state- 
ment is summarized in the list of the following 
principles. 

1. An exclusive publication agreement for a 
limited period of time up to/ years may be 
reached betweerl a grantee and a publishing 
cbmpany after appropriate competitive bid- 
ding. Alternatively, non-commercial 
publication of sample materials for 
classroom use may be approved pending the 
appearance of similar commercial versions 

. satisfactory to the project produced under 
normal individual author/publisher 
arrangements. 

2. There should be no implication that the 
Federal Government or the Foundation has 
placed a seal of approval on these materials; 
they should make their way on their own 
merits. 

3. Commercially published materials must be 
priced to be competitive in the textbook 
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^'market. This qualification is included so 
that materials developed through support 
•with public monies will not have an. unfair 
price advantage. In order that there not be 
an undue advantage to the publisher, nor- 
mal royalties to the grantee are requireiJ. 

4. Utilization of royalty income by the grantee 
is determined by the Foundation. 

5. Publication arrangements include a ter- 
mination clause so that the book may be 
withdrawn from the market after an ap- 
propriate interval if that becomes desirable. - 

' 6. All contracts must include a reservation on 
materials for Government use. 

7. Control over content and all subsidiary 
rights (translation, etc.) remains with the 
grantee although thn specific contractual 
arrangements are subject to NSF approval. 

"'This policy contemplated various distribution 
arrangements, including exclusive publication of 
a hardback -edition which could compete with 
other texts containiag similar material for the 
same target population. This was adopted with 
respect to PSSC. BSCS, and CBA. A second 
technique used in the CHEM Study project was to 
hire a publisher as a printer with the grantee con- 
trolling the distribution. Another procedure was 
employed in the case of SMSG which published 
its materials in soft cover for sale on a nonprofit 
basis and encouraged large-scale ^'borrowing'* 
from its materials on a non-exclusive basis by 
othe^.rs who then prepared commercial hardback 
editions. 

' In March 1966, a different approach was taken 
to the period of exclusivity permitted the 
publisher by requiring the g^rantee and publisher 
to provide for the royalty-free' use of the 
materials after a specified amount of time. A 
sample free-use statement follows: 

Permission is herby granted by the 
; copyright (jwner to all persons to make any 

use of this work after ,* 

provided that publications incorporating 
materials covered by this copyright contain 
an acknowledgement of this copyright and a 
slalemeat that the publication is not en- 



* Thtj ilatif tr) 1)p insei'U'd hvw. is lo nji^oliatcd. Il would 
usiiiilly »:(iirj'S[)nn(l to tin* iinrinnl rf\'isirin cych-s (»( A lo 'i 
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dorsed by the copyright holder. In the exer- 
cise of this permission, copies of the work or 
portions thereof may be made after 

** provided that no public 

release of such copies is made until 



By 1968 enough issues had been examined and 
tentative positions formulated with respect to 
these issues taken to frame a staff paper which 
was "^presented to the 117th Meeting of the 
National Science Board, March 21, & 22, 1968. 

One particular issue which had not received 
much attention prior to this time was the problem 
of film distribution. F.arly policy had been 
generally consonant with the notion of exclusivi- 
ty already developed for publications. The staff 
paper, however, presented the proposition that 
film distribution on a non-exclusive basis was 
feasible in view of the advent of a practical, inex- 
pensive, 8 mm system utilizing cartridge load 
film loops developed by Technicolor. 

As a next step, a preliminary discussion of the 
staff pajDer was held at the July, 1968 meeting of 
the Advisory Committee for Science Education. 
Because of limited time and the complexity of the 
problem, the Chairman of the Advisory Com- 
mittee appointed an ad hoccommittee to examine 
the film problem in greater depth. It was agreed 
at that meeting that the ad hoc conference should 
be held on September 25, 1968 at which time the 
participants, in addition to NSF staff, should in- 
clude representatives of the publisher, film dis- 
tributors, grantee institutions and members of 
the NSF Advisory Committee for Science Educa- 
tion and of the National Science Board. The one- 
day conference reviewed a revised staff paper on 
proposed publication policies. The results of the 
conference were reported to the Advisory Com- 
mittee for Science Education on November 7-9, 
1968 at which time the Committee endorsed the 
proposed policy positions presented. 

The document entitled Policif^fi for ihn Dis- 
iribuiiou of Puhiicolions and OthtT Mnloriuis 

Dv.valnpad Under llie . Sciencci fjiiiafUian' 

Pr{)grams of (lie Nutionoi Scionco Foundation 
was submitted as NSB-69-52 at the 123rd 
M(ieling of the National Science Board, February 
13-14, 1969. The Board approved the statement 



* * 'I'his (lah; would \)u in advaiicr? of th'(; i(df;as(! by an inler- 
^al Mitiii.iciit 1(1 j^ivc puldishiM's. ^^rcpaiation and piintin^ 
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:ahd requested that it be implemented 
? "immediately but not retroactively". General dis- 
• tribution of th6 policies was made with an effec- 
live date. of February 14, 1969. Since 1969 there 
has been relatively little change in the publica- 
tion policy with the exception of new provisions 
dealing with' the control and disposition of in- 
come which will be discussed later. Approved 
I changes included: 

1. Thci requirement of an acknowledgement 
and disclaimer clause which must be 

. printed on the copyright page of the printed 
^ materials: 

"Development of these materials was sup- 
ported in. whole or in part by the National 
Stience Foundation. Any opinions, fin- 
dings, conclusions or recommendations ex- 
pressed herein do not necessarily reflect the 
views of the National Science Foundation or 
the copyright holder." 

2. Further, the free-license notice which is alsp 
to appear on the copyright page.was chang- 
ed to its present form which requires reprin- 
ting of the acknowledgement and disclaimer 
as* well as the original copyright notice: 

**Except for the rights to materials reserved 
by others, the publisher and copyright 
owner will grant permission for use of this 
work, in whole or in part, in the English 
lahguage in the United States, Canada, and 
Mexico without charge or other royalty 

after— , provided that publications 

incorporating materials covered by these 
copyrights contain the original copyright 
notice and the statement: 'Some (All] of the 
materials in this work were developed with 
financial support of the National Science 
Foundation. Any opinions, findings, con- 
clusions or recommendations expressed 
herein do not necessarily reflect the views 
of the National Science Foundation or the 
copyright holder.' For conditions of use, or 
permission to use material contained herein 
for foreign publications or publications in 
. other than the English language, write to the 
publisher (copyright owner).** 

3. "Domestic" distribution was expanded to 
include Mexico. 



Income and Its 
Distribution 

Income may arise from NSF science education 
grants by sale, rental, licensing or pther disposal 
by grantees of texts, films and other materials 
developed or produced with Foundation support. 

It has been the Foundation*s long-standing 
policy that grantees should not profit from sup- 
port received by the Foundation. Therefore, the 
Foundation has usually 'included a requirement 
in project awards that income be accounted for 
over a specified period, reported to the Founda- 
tion, and disposed of as directed by the Founda- 
tion. This is reflected in the sample clause (21 
from the 1962 grant example on the first page of 
this section. 

In most instances since the early 1960*s com- 
mercial publishers have been required to pay 
royalties to inhibit them from underselling other 
available materials and gaining a competitive adr 
vantage as well as from realizing excessive 
profits— since they did not incur development 
costs. When the "free use" policy was instituted 
in 1966, the publishers obligation to pay 
royalties was limited to the period of exclusivity. 
However, this was changed in the 1969 NSB 
Policy Statement which required the continua- 
tion of royalties unless the pubHsher could 
demonstrate that he had not recovered his invest- 
ment. The negotiated royalty rates have varied 
from 3-20 percent and depend on a variety of fac- 
tors including the price of competing materials, 
the publication and distribution cost of NSF- 
siipported material and the contributions of the 
pubhsher. 

In October 1964, the income policy was revised 
by a. Memorandum from the General Counsel 
which was adopted by the Director in Office of 
the Director Staff Memorandum 61. This- 
memorandum required NSF to remit to the 
Treasury escrow accounts resulting from royalty 
payments by publishers from sale of course 
materials. In addition, consistent with a recent 
GAO decision on revolvingfunds, the memoran- 
dum authorized the use of grant funds for the 
printing of trial editions and reuse of theincome 
thus generated in a revolving fund for further 
printing and sale of such material. Any money 
remaining in the fund at the end of the sale period 
would be considered part of the grant so long as it 
did not exceed the initial amount provided for the 
printing. 
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Prior to thia time, informal revolving funds had 
been used in several instances. For example, in 
I960 SMSR was given permission to use $14,000 
of income received from sales of texts and related 
documents for "general purposes of the School 
Mathematics Study Group" which included prin- 
ting additional copies of materi&ls for sale. In the 
same year, CBA received similar permission. A 
formal revolvitig fund was established in 1963 
for the specific purpose of authorizing the Un- 
iversity of California to use funds from the **in- 
come account" to reprint 50.000 copiies each of the 
CHEM Study Text and Laboratory Manual. 

However, in 1968 GAO questioned the authori- 
ty of NSF to classify •"ontrsed-^revolving fund 
money as available for general use, and in 1969 
issued a decision that such money must be 
remitted to the Treasury in accordance with 31 
use 484. The Comptroller noted that since the 
proposed use of.the remaining funds constituted- 
an augmentation of NSF appropriations, specific 
statutory authority was required. 

This GAO opinion precipitated a re-evaluation 
by NSF of its treatment of royalty income. After 
many drafts were written and discussions held 
with GAO, a revised policy finally emerged in 
January 1972 as Circular No. 106 (copy attached). 
Prior to its issuance, it was reviewed by GAO 
which indicated that it would raise no objection. 
It was then presented to the NSB by Director 
McElroy in November 1971. The Board, however, 
has never formally approved this policy. 

In his memorandum to the Board, the Director 
noted that the proposed policy requested a 
change from the statement approved by the NSB 
on February 14, 1969, on treatment of income. For 
example, the 1969 policy required all income to be 
. remitted to NSF except for amounts necessary to 
pay administrative costs related to the manage- 
ment of the income-producing property. In addi- 



tion, provision was made for the release of in- 
come when the level became nominal. In contrast, 
the new statement provided for the use of income 
to offset costs of grant activities as well as ad- 
ministrative costs rof the income-producing 
materials. Also, the new policy permitted the 

.grantee with Foundation pe^rmission to keep all 
income and use it for science^r science education 
purposes if the income was not expected to ex- 

> ceed $10,000. Any income ove^ this amount was 
required to be remitted to NSP\^This new policy 
was applied to income arising frpm either grants 
or contracts. \ 

Incpme as defined in Circular 106 may also in- 
clude interest on royalty accounts- a subject-of- 
continuihg interest to GAO. Thus^if a grantee 
places royalties in an interest-bearing account, 
any accrued interest would be considered income 
and subject to the procedures and policies of Cir^ 
cular 106 and any income cjause in the grant or 
contract. Circular 106 does not' repjresent a 
change of policy in this area becausej interest 
-could have been broadly interpreted to be 
covered by phrases in iYie income cfau^es in tise 
prior to 1972 such as 'income derived from rents 
or royalties" or *'all income". ' 

Income may also arise from the sale by the 
grantee of revision rights. Under present-publica- 
tion policy, a revision is treated the same as the 

. original edition if the revision is developed dur- 
ing the period of exclusivity. Accordingly, 
royalties are owed on the same basis and must 
contain the same free-use statement. Revisions 
are not permitted to be published less than one 
year prior to termination of the exclusivity 
period. However, if the publisher brings out a 
revised edition ^t his oWn .expense after the 
period of exclusivity has expired, he is free to use 
parts^of the original work without payment. 
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NATIONAL SCIENCE FOUNDATION 

Of1k9ofti99A$ikmnDkmoffotAdmhlsintion 
WASHINGTON. D.C. 2QB60 



NSF CIRCUL 

GRANTS AND CONTRACTS 

Subfect: tneoiiM Undtr Foimdaiion Gram 

1. Purpote. Thit Circubr establishes Foundation 
policy and delegates responsibilities governing the 

— managsmtnt and disposition of income generated under 
Foundation grants and contracts. 

2. CanocBatkMi. This Ciicular cancels 0/D Staff 
Memorandum^61, Dispostion of Foundation Receipts, 
dated October 22, 1964. 

3. Dcflnition of Inoome. As used throu^out this 
Circular. Income refers to that portion of gross revenues, 
inchiding royalties, received by or accruing to a 
Foundation grantee or contractor through activities 
undertaken in the performance of its grant or 
cost>reimbursement type contract whether received 
during or after, the grant ,or contract period. Income 
includes but is not limited to proceeds received by a 
Foundation grantee or contractor from the sale, 
licensing, lease, rental, or other arrangement for the use, 
release, dissemination, or other disposal of books, 
monographs, films, and other materisl and properties, 
except inventions, developed or produced with 
Foundation support. Income also includes any interest 

' earned on all such revenues and proceeds, but interest 
earned on grant or contract funds is not inchided. 

4. PoUcy. Prior to making a grant or contract . 
award, the Foundation will consider the nature of the 
project* the purpose of Foundation support, the amount 
and source of expected income, and other relevant 
factors and determine what provisions the award should 
contain regarding the disposition of anticipated income. 
In the event that realized income is in excess of the 
estimated amount or unforeseen circumstances should 
arise, the grant or contract may be amended to provide 
tor other appropriate disposition of such income. 

a. Grants. 

(1) All income will be accounted for 
and. normally, grants will provide that (a) income 
received by a grantee during the life of a grant will, 
k> the extent, practicable, be used by the grantee to 
offset costs otherwise allowable and chargeable to the 
grant and (b) income will be used to cover reasonable 
* expenses associated with the administration of the 
income producing activity. 
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(2) Normally, where total income is 
estimated to be less than $10,000, the grant may provide 
that income not used as provided in the grant shall be 
retained by the grantee to be used for science or science 
education purposes, provided, however, that any 
remaining income in exceu of SIOJOOO, or such lesser 
' ' amount u may be specified in the gnnt, shall be 
remitted to the Foundation.. 

C3) Where appropriate, ^ants may 
specify odierruses for income audi as (a) in certain • 
deficit support type grants, inoome may be permiUed 
to be used to cover reasonable expenses associated with 
the project during the grant period and thereafter which 
wire not reimbursed from other sources, or (b) in 
certain grants where the purpose is to make an activity 
self-sustaining, income may be permitted to be used io>' 
continue the activity. 

(4) Where total income b estimated to 
exceed $10,000, the grant will provide that all income 
not used as provided for in the grant will be remitted 
to the Foundation. 

(5) All income required to be remitted 
to the Foundation will be kept in a separate account 
and will be reported on and remitted semiannually for 
ten years or such other period as may be specified in 
the grant, provided, however, that should such income 
fall below $2,500' per year, for any two successive 
calendar years, the requirement for further reporting and 
remittance may be waived. 

b. Contract!, The disposition of all income 
in which the Foundation may have an interest shall be 
provided for in the contrKt and, to the extent 
appropriate, shall be consistent with grants policy. 

(1) Use of Income During Life of 
Contract Normally, income received by a contractor 
during the life of a . cost;reimbursement type contract 
will be accounted for and td the extent practicable, 
unless otherwise provided by the contract, be used to 
offset costs chargeable, to the contract. 

(2) Return Unused Income. To the 
extent that income received or accrued during the life 
of the contract is not used as provided by (1) above. 
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such, net income shall be remitted to the Foundation. 

\^ c. Return of Interest. Any interest earned 
on gr^t or contract funds shall be remitted to the 
Foundation and deposited with the Treasury. 

d. Return cf Income. Income remitted to 

and-co ntr ac ton 



will be deposited with the Treasury as provided by law. 

e. Income Reports to 0MB and Congress. All 
income and faiterest remitted , to the Foundation by 
grantees and coiftractors or required to be reported on 
by grantees and contractors will be reported by the 
Foundation to the OfTice of Management and Ikidget 
and to Congress. 

5. ReaponsiUUties. 

a. Frvgnm Offices, Foundation Program 
Offices are responsible for identifying, on the 
appropriate forms, proposed awards whidi are 
potentially htcome producing. Further, they are 
responsible for providing recommendations to the 
Grants arid Contracts Office on the proposed treatment 
and use of income. 

b. Grants and Contracts Office. The GranU 
and Contracts Office is responsible for: 

(1) Verifying the income potential of 
proposed awards: 

(2) Developing and including in income 
potentiat awards, appropriate clauses or requirements for 
the accounting, reporting, and disposition of income in 
accordance with the policies set forth in this Circular* 
and for coordinating with the Program Office, OfTice 
of the General Counsel, and other ofHces as appropriate. 



(3) Receiving and reviewing all reports, 
proposals, and other communications from grantees and 
contractors regarding income, and, as appropriate, 
forwarding such documents to the Financial 
Management OfTice and Program Offices. 

-(4) — Issuing all inifnirtigns, apprmeals^ 



determinations,, and other communications to grantees 
and contractor^ regarding income after coordinating 
with the Program (^ice and Office of the General 
Counsel as appropriate. 

c. Fbmckd Management Office. The 
Financial Management I Office is responsible for receiving 
and accounting for income reported or remitted to the 
Foundation, for preparing periodic reports on income, 
and for dlsposiiv of income received by the Foundation 
policies set forth'in this Circular. 
Office. The Budget OfTice is 
responsible for obtaining income information from the 
Fhiancial Management ORice and preparing the income 
reports to Congress, the Office of Management and, 
Budget, and others as appropriate. 

e. Audit Office. The Audit Office is 
responsible for the audit of Foundation grantee and 
contractor income, for reviewing their compliance with 
the income provisions of their grant or contract, and 
for otherwise examining and reporting on grantee, 
contractor, and Foundation practices and procedures 
regarding the management and disposition of income. 



in accordance with the 
d. . Budget 




[T. E. Jenkins ' 
AcTmg Assistant Director 
for Administration 
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Procedures for Oversight and Ev&iuation 



Curriculum Content 
Oversight 

NSF policy on oversight and evaluation for 
curric ulum content has for the last ten year s, 
been based on the program policy statements 
contained in the March 1965, Status Report on 
the Course Content Improvement Activities of 
NSF. Article 2 of the report sets a requirement for 
"first-quality scientific leadership" in NSF sup- 
ported projects; Article 6 states that "study 
groups are to be given the fullest freedom to 
develop their materials according to their best 
professional judgment" and that "their 
professional judgment should not be influenced 
unduly by^aoy vested interest group nor by any 
member aOne National Science Foundation/' 
Further, "there must be no implication of 
governmental responsibility for, nor endorse- 
ment of, the content or organization of the 
materials.*> Article. 7 requires that "both the 
Foundation,and project staffs disclose to respon- 
sible individuals and organizations, including 
comrriercial organizations, information on the 
work of a project." 

During analysis of these procedures, the sub- 
ject was approc^ched from the viewpoint of "what 
happened"; a subjective judgment was not made 
as. to "what should have happened." The 
milestones for determining "what happened" are 
similar in the evolution of any curriculum im- 
provement project. Oversight and evaluation 
takes many forms; internally by NSF manage- 
ment and staff ' review, and externally by 
mechanisms such as peer review of proposals, 
reviews by members of the teaching and 
p.ublishing communities, and evaluation by 
students and parents. 

During the currioulu'ni development phases, 
three distinct stages are evident— fl) the pre- 
award period during which a project is being 
planned and organized and a proposal prepared, 
(2), the award period during which most of the 
substantive work of the project is carried out, 
and (3) ,the "overlap" period during which 
curriculum materials are finalized, testing nears 
completion, publication arrangements are made, 
and teacher training begins. 

The procedures for oversight and evaluation 
for content appear to be unique to each of the 
cases studied at every stage of development. In 



the case of CHEM Study, the proposed concept 
and design were subjects of active consideration, 
during visits preceding the formal review of the 
proposal. NSF staff attended meetings of the 
steering, planning, and organizing committees 
and was kept fully informed on the direction the 
project would take. Proposal revisions were 
made within a month and deficiencies cited by. 
reviewers were corrected. In contrast, since the 
NSF staff judged that coordination of the Com- 
paring Poliiicol Experiences (CPE) project by the^ 
American Political Science Association filled the 
need for the pre-a ward oversight function, no site 
vists were included in initial considerations. In 
the case of Science Curriculum improvement 
Study (SCIS), Man: A Course of Study 
(MACOS), and Individualized Science Instruc-.. 
iionol System (ISIS), the reputation of the prin- 
cipal scholars and peer revie^w performed by ex- 
perts in the various fields formed the principal 
basis for the pre-award oversight function 
without extensive NSF staff involvement. NSF 
staff members were however, involved in ISIS 
needs assssment conferences. 

As each project approached the award stage, 
the oversight and evaluation function evolved. 
The original steering committeejor CHEM Study 
performed the oversight function and provided 
overall direction to the project. NSF staff par- 
ticipated in steering committee meetings. A 
pattern of advance planning with NSF feedback 
and subsequent action was firmly;:established in. 
the project. A CHEM Study newsletter was 
developed to inform thecommunity of Ihegroup's 
activities and was mailed to school supervisors 
and teachers around the country. In addition, for- 
mal descriptions were published in a variety of 
educational journals to reach a wide audience. 
Copies of all materials produced were received 
and reviewed by NSF staff. 

During the initial stages of the development of 
Man: A Coarse of Study, an oversight committee 
was fornied, variously referred to as a planning 
or executive committee. It consisted of scholars 
from prominent universities and grantee top 
management. There was little NSF-grantee in- 
teraction during curriculum development. 
Primary reliance was placed on peer review of 
proposals requesting additional support, and on 
progress reports included in these proposa-ls. 
The basic philosophy for oversight of Com- 
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paring Political Experiences (CPE) was to place 
major reliance on a highly qualified Project 
Director and to provide only minimal monitoring. 
As is the case in other grants, major reviews oc- 
curred annually when requests for additional 
funds were received. 

No defined, monitoring or reporting re- 
quirements were initially planned for SCIS; 
reliance was placed on annual reviews of renewal 
proposals. Site visits and major reviews were 
conducted to iron out problems as they occurred. 
The oversight system was informal and mainly in 
response to requests of the Project Director, until 
later when an oversight committee evolved 
within the project team. 

The oversight function of ISIS rests with the 
Project Director and an advisory committee 
which includes scholars with a variety of 
backgrounds and interests (see ISIScasestudy). 

Content evaluation procedures also took £i 
variety of forms during the development stage. A 
content evaluation system was built into the 
CHEM Study project from the outset. The first 
draft of the text was written and put to use by 
participating teachers who fed back their ov^ 
and student reactions. Modification and revision 
was a constant process over a two year period at 
the end of Which the final text was virtually com- 
plete. Prime responsibility for selecting and 
evaluatfng content and accuracy of the material 
resided with the Steering Committee.* 

For MACOS, the grantee supported an evalua- 
tion study whij:j:h resulted in the publication. 
Curiosity /Compcterlce/Conl^nlInit3,^• EvQluQtion 
of Man: A Course of Study." (Hanley, I. P.. VVhitla, 
O.K., Moo, E.VV., and Walter, A.S., Education 
Development Corporation, Cambridge, Mass., 
1970) The evaluation of the early pilot verions of 
the course repealed problems in several lessons 
and materials on which the developers based 
revisions. In addition, a grantee evaluation of the 
10th grade materials led to their decision to dis- 
eontinue development of these materials as 
originally envisioned as part of this Social 
Studies Curriculum Project. An EDC proposal of 
3/29/68 requested funds for continuation of the 
5th grade curricula and a new 10th grade 
curricula. NSF elected to support only the 5th 
grade segment of this proposal. NSF is currently 
supporting an evaluation of MACOS by Russell 
Cort of Antioch C(jllege. 

In Conipnrin<^ l^oUtical Kxpfirir.ncf^s i\ cf)nU?nt 
evaluation function was conhimplatcd in the 



original proposal and was acknowledged in. the 
grant instrument as being the responsibility of 
the Project Director. The grant instrument 
cautioned that results of the activity were the 
responsibility of the grantee and not to be 
represented as being by or for theNSFor the U.S. 
Government. As of April 1975, a formative 
evaluation was being conducted at pilot schools 
by staff of Indiana University (subcontractor) 
and the American Political Science Association. 

The ISIS project evaluation plan calls for in- 
dividual approaches to the formative evaluation 
of each module of the curriculm. A jnodified 
Delphi technique is to be applied to provide a 
reasonable range of opinion held by acknowledg- 
ed experts in the field. Evaluation specialists and^ 
module authors will be provided baseline data 
from tryout school records. Teacher and student 
opinions will, he collected by questionnaire ^ 
and/or direct interview. The evaluation features' 
of this project are built into thegrant operation to 
be. carried out by the Florida State University 
project slaff. 

Thb evaluation procedure for SCIS, although 
not included in the original proposal, was built, 
into grant amendments and included pilot 
studies in Michigan and New. York schools as 
well as a formal independent evaluation which 
resulted in ^ report upon which revisions were 
based. 

. In viewing procedures during the implementa- 
tion phase, it becomes evident th^t^ the re- 
quirements for oversight and evaluation for con- 
tent is reflected in the publication arrangements 
and in the mechanisms used to disseminate infor- 
mation about the curriculum projects. There 
appears to be a degree of overlap between the 
development/ and implementation phases 
because the project oversight committees and 
^ teams continue to interact with the publishers 
and marketers of the course materials. New overr 
sight forces enter the picture, however, as school 
systems are made aware of the materials and the 
system decisionrnakers, resources personnel, 
and classroom teachers are given the (jpportunity 
to review the' materials, work with them and 
evaluate them. In this way, CHEM Study had 
great success in gaining wide public acceptance 
of materials content and new teaching concepts. 
MACOS, on the other hand, has encountered con- 
.Iroversial views on content and th(i innovative 
feature.s of its multi-media materials and teacher 
training programs. For the ni(jst part, Ihe NSF 
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position on implementation has been that 
traditional American policy places responsibili- 
ty for selection of subject matter used in the 
schools in the hands of appropriate school 
authorities, public and private. 
The CHEM Study grantee published reports on 

* the project in national journals and mailed a 
newsletter to schooldistricts around the country. 
One of the first CHEM Study films enjoyed great 
success and was shown to a wide audience on 
national TV, many requests for information were 
received by the project staff. Gradually, teacher 
institutes adopted CHEM Study materials and as 

* teachers became acquainted with the new 
materials, they were adopted for use in 
classrpQms around the country. 

MACOS has received a great deal of publicity 
and remains controversial. Numerous scholarly 
articles have been published in professional jour- 
.nals, the innovative and controversLxil features of 
the course have been aired in newspapers and 
magazines and Congress, and the public at large 

* have^ debated the pros and cons of the course 
material in print and on television. 

MACOS implementation began in 1969, initial- 
ly by the developer with NSF support, and since 
1970 has continued through course developer- 
commerical • publisher arrangement. Major 
features are the requirements for teacher train- 
ing, a developer-publisher program of R&D on 
course materials which provides results of their 

^-efforts to users on a continuing basis, and other 
awareness mechanisms where content is analyz- 
ed and evaluated. 

SCIS evaluation procedures "during implemen- 

. tation included a field test of evaluation 
supplements for the three upper levels of the 
program during the 1973-1974^ school year in 
which about two hundred teachers participated. 
Many articles have been published about this 
course in educational journals, films are 
available to explain it. and itscontent has been a 
topic in several workshops, institutes and other 
teacher and resource personnel training 
programs. 

The materials from ISIS have not yet been fully 
implemented, however several journal articles 
have been published and a regular developer- 
issued newsletter is sent to the participating trial 
centers and school districts. 

Comporing PoUUcqI Exporicncaa (CPE) is still 
in the development stage and its content con- 
tinues to be subjected to scrutiny in local school 
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systems and-^ by individual schools. Complete 
data are not readily available on the impact of im- 
plementation activities. 

OVERSIGHT OF 
IMPLEMENTATION 

The Federal Government has an important role 
in assisting State and local educational units to 
create equgl education opportunities and in es- 
tablishing standards and models for educational 
processes. States and local school districts come 
lo the Foundation for assistance in this process 
and the Founda^tion supports projects which 
directly or indirectly involve State education 
agencies. It is felt that in the real world it is simp: 
ly not sufficient to develop good materials— they;^ 
will not be used unless they are given a healthy 
jgiush. Some publishers try to assist schools with 
training workshops but admit that their efforts 
are often superficial and inadequate. Implemen- 
tation is expensive, and the, book-publishing in- 
dustry is relatively small land facing serious 
economic problems. New drograms other than 
those supported by NSP frequently gather dust 
because teachers lack the knowledge base and 
training to use them. Because of this, the Founda- 
tion welcomes implementation proposals for 
other than NSF' sponsored curricula; without 
adequate teacher training the investment for 
their development would be lost. 

All the major curriculum projects have more or 
less systematic information programs associated 
with them, including, publication df newsletters, 
preparation of articles for professional scientific 
and educational journals, replying torequests for 
information in person and by letter, and oral 
presentation upon invitation before scientific, 
educational and lay audiences. Progress reports 
appear periodically, copies of preliminary ver- 
sions of textbooks and other materials are made 
available to all interested persons. Projects of 
lesser scope use similar channels, but on a reduc- 
ed scale, with principal reliance on publication 
and disFcmination of final reports in journals and 
other publications. In the early years of Founda- 
tion activities in curriculum improvement, it was 
felt that in addition to the information activities, 
it wotHd be necessary in some manner to provide 
adequate teacher preparation for the tt}aching of 
the new curriculum in the various schools in the 
country. 



The first secondary school institutes used were 
NSF sponsored as a vehicle for training teachers 
in the utilization of newly developed curricular 
materials beginning in 1958. Between FY 1958 
and FY 1961, teacher training in curriculum 
materials for UISCM. PSSC. SMSG. CBA. 
CHEMS, and BSCS was included in the summer 
institutes program. In attending these programs, 
no teacher was required to install one of these 
revised courses in his school. 

With the termination of the summer and in- 
service institutes for elementary school teachers 
in 1966, the Cooperative College-School Science 
Program (CCSS) became the sole vechicle for 
assisting elementary school personnel to receive 
training in new curriculum materials. The 
earliest CCSS programs were participant- 
centered, and their effects on school systems 
were transmitted through students and 
teachers— the students bringing a sense of need 
and urgency back to their school and the teachers 
bringing back someanswers to that need. Several 
institutions devised CCSS programs with the im- 
mediate purpose of helping schools introduce 
new course material. 

A series of conferences were supported begin- 
ning in 1967 to disseminate information about 
new curricular efforts. 

An NSF-supported conferenco was held at the 
University of Maryland in January 1967. The 
conference focused on implementation problems 
associated with elementary curricula but many 
of the conclusions were easily translated to the 
secondary school segment. In FY 1970 a larger 
share of the Course Content Improvement 
Program allocation went into the implementation 
activity and even though there was no restriction 
with regard to consideration of non-NSF sup- 
ported curricula improvement, most of the pro- 
jects supported through this program involved 
NSF-supported curriculum endeavors, 
^Beginning in FY 1974, the Foundation in its 
newly established Instructional Improvemijnt 
Implementation Program, provided a coor- 
dinated focus for all implementation activiliCvS of 
curriculum revisions. 

As discussed, implementation activities have 
been carried out through a number of different 
programs. In the early years, proposals sub- 



mitted to the Foundation in theWarious programs 
such as Summer Institute Prdgram, In-Service 
Institute Program, Academic! Year Institute, 
CCSS, and so forth, received i\ peer review. A 
typical review in the Educational Directorate in- 
volved convening a large number of panelists at 
one time, assigning them to panels of three in- 
dividuals, each with a panel leader and asking 
each panel to review a specific number of 
proposals. Each panel's propo,sals were then 
reviewed by at least one other panel of reyiewers. 
The ratings of the panels were reviewed |by NSF 
staff. Awards were based on the Program Direc- 
tor s own knowledge plus his judgment of the im- 
pact of the reviews. 

The NSF role has been limited to providing 
support of curriculum improvement. The Foun- 
dation staff does not play a- Strong role in the 
. oversight of the effectiveness of the implementa- 
tion activities even though there are interim and 
final reports available and site vists are 
sometimes made. The NSFGuidc for Preporotion 
of Proposals and Operation of Projiicis for /n- 
stniclional Jmprovomcnt Jniplementation con- 
tains the following: 

"Project Kvaliiiitidn 

*rh(! iitic.ijuncy of \\m) evjiliiation plnn will he. consiilnul in tlin 
ri'viciw of the proposals. 'VUv. I'dundntion nxp(M:t,s thni effec- 
tive! pri)po,sals will incliicln plnn,s foroviiluation to d(it(!rmine 
wlKMlier or not I he specific uhjectivc.s of I he project have lieen 
iii'.hieved. The plan would also noruially include strategies foi^ 
^alherinji In formal ion to assist project directors in i in pr ovinia 
their projects in the future." 

The Prti'Colh^c Education In Scionco Program 
Hevidw of January 21, 1975, contained 
statements to the effect that, "Studies focused on 
. implementation issues such as the persistence of 
innovations, analysis of the cost-effectiveness of 
different implementation approaches, analysis of 
the factors affecting the extent and quality of im- 
plementation, etc., should be pursued. Baseline 
data cm current usage of materials, the impact of 
our implementation' strategy, and assessment of 
the different implementation models are needed. 
These are only a few of the many issues which 
must be addressed to obtain information for 
practitioners to use in improving implementation 
mechanisms and 'approaches and for the im- 
provenient-of our own activities." 

ti9 
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Appendix 4 

Summary 
Case Studies 



Five curriculum development projects were chosen for detailed study 
by the science curriculum review teamiSynopses of these Qase Studies 
were presented in Volume I of this, report. This appendix presents the 
complete summary reports prepareJj by members of the yeview team. 
Problems suggested after examination of the assembled matprials on each 
case Study are summarized and were used as bac^rpund for the 
recommendations of the Advisory Committee for Scienc\Education and 
those of the chairman of the review, team (Volume I, Se^ion III]. 

Additionally, most of the case studies include grant information, lists 
of courses developed and detailed data ©n deT^elopment And implementa- 
tion processes. \ / 

The case studies are presented n tHe following otder: 

1. CHEMSNidy / 

2. Science Curriculum Improvement Study (SCIS) 

3. Comparing Political Experiences (CPE] / 

4. Man: A Course of Study (MACOS) / 

5. Individualized Science Insti^uctional Sys'tem (ISIS) 

As noted in Volume I, these curriculum dev/elopment projects were 
chosen for detailed examination because they Represent different dis- 
ciplines, are at differing stages in thp total process and illustrate ways 
that the jirocess from proposal to implementation has varied over the 
y^ars. 
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CHEM STUDY 



Chemical Educational Materials Study (CHEM Study); University of Cali/ornio, Berkeley; $2,766,160; 

1960-1972; Grades 10-12 \ 

\ ■ 

reading lists, wall, charts, and laboratory equip- 
ment items were developed for flexible use 
depending on situations. 

The history of the development of. the project 
can be understood more easily if placed in the 
context of the^ early period of the Foundation's 
history. Frohi its beginning, NSF established the 
policy of usirig-advisorypanels composed of out- 
standing individuals from the private sector to 
assist in determining how the Foundation could 
best fulfill its congressional mandate. Minutes 
from the early meetings between NSF staff and 
the Advisory Committee for Education substan- 
tiate that as early as 1954 NSF considered im- 
provement of science curricula to be one of its ob- 
jectives. There was concern at that time that re- 
cent developments in the sciences were not being 
incorporated into traditional curricula and that 
the sciences were, not adequately presented in 
high school curricula. During the mid-fifties 
attempts to remedy these .shortcomings at the 
high school level largely took the form of small 
conferences between research scientists and high 
school teachers from selected disciplines along 
with (1 modest effort to develop supplementary 
aids for specialized areas. 

Following disjcussions with the advisory 
group, NSF determined to develop a more com- 
prehensive prograxn forcurriculumdevelopment. 
Textbooks were seen by NSF and the experts as 
badly in need of revision, thus at this time the 
policy was initiated of soliciting top-flight scien- 
tists to undertake revisions in cooperation with 
high school teachers. The initial statement- of 
general principles in support of course content 
improvement was developed and endorsed by the 
Advisory Committee at its November, 1975, 
meeting. 

The growing concern over the perceived 
deficiencies created a cliniaie^of thought in the 
late fifties among research specialists which led 
them to become increasingly willing to devote 
personal effort tp their correction. The coin- 
cidence of interests between NSF staff and the 
scientific community furnished the impetus for 
suhst«mtial efforts in curricular development. 
The fir.st major curriculum revisions under- 



The subject grant was initiated in April 1960 
and was continued over a 12 year period, ter- 
minating in December, 1972. Its objective was 
"Organization of a chemical educational 
materials study to prepare, through research and 
study, textual and experimental materia! to aid in 
development of a modern chemistry teaching 
program for U.S. high schools," Including earlier 
awards to develop plans for the project, NSF in- 
vested $2,766,160. The royalties accrued from the 
matei-ials produced . under the project and 
remitted to the United States Treasury came to 
$3,563,794. An additional $463,654 was 
reawarded by NSF. 

More than $2,500,000 had been awardedby the 
end of 1962, but the grant was left open to provide 
for reprints of the material and the return of 
royalties to NSF. Occasional modest 
amendments were made during the ensuing years 
to cover administrative costs. The grant was ter- 
minated following a projected accounting which 
indicated, essentially, that the administrative 
costs associated with the return of royalties to 
NSF would exceed the anticipated royally in- 
come. 

At this time the decision .was made to release 
the University 'of California, Berkeley, from 
further obligation to remit royalties to NSF. 

The published material developed in the 
CHEM Study program included the textbook, 
laboratory manual, teachers guide; a series of 
achievement examinations; supplementary 
programs introducing exponential notation and 
' slide rule; film transcripts and a teachers guide 
to the films. In addition, 29 films were produced. 
These were designed to introduce data that could 
not be acquired through student experiments and 
to provide clarifying models.' 

The written materials could be used together or 
as individual supplementary components. Films 
could be obtained on a subscription, purchase, or 
lease with option to buy basis and arrangements 
were made for previewing them. Additionally, 

« For titles, spo Tin; CUEM Study Sfory. R. ]. M(/rrill ami 1). 
\V. Riclj{\viiy. W. H. Fri'ctniin i\iu\ Cn.. S.in KriinciMMi. C^ililnr- 
nia. 19B9. 
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taken by NSF were in physics, biology and 
mathen[iatics-and it is against this background 
that the chemical scientists were actively dis- 
cussing new content for chemistry courses. Dur- 
ing 1957 through 1959 the Education Divisu)n 
had a succession of chemists on its staff ^l\o 
were active in this effort before, during, and after 
their tenijre at NSF, During the same period, the 
American Chemical Society (ACS) and private 
foundations were independently stimulating 
similar efforts. 

The conference that resulted in NSF's first 
award for revision of a chemistry text was held in 
June 1^7 under the sponsorship of ACS and the >^ 
Crown-Zellerbach Foundation. Apparently some j 
participants believed that the *'Chemical Bond 
Approach,'* conceived at the conference, would 
riot satisfactorily tneet needs and continued ef- 
forts, through the ACS Division of Science 
Education, for a second undertaking. 

An ACS ad hoc Committee on Education 
(chaired by a former NSF rotator^, and ACS 
member) arranged a two-day conference in 
Washington with NSF representatives to discuss 
plans. An ambitious scheme for revising texts, 
lab manuals, and supplementary aids was outlin- 
ed and received the unanimous endorsement of 
the ACS group along with strong encouragement 
from NSF; 

It was agreed, in the interest of soliciting 
opinions other than those represented at the con- 
ference, that an Interim Planning Committee 
should be formed. Dr. A. B. Garrett, Ohio State 
University, w4s named chairman and support for . 
the activity oif the group was obtained from NSF 
in the spring/of 1959. By fall, ideas on content and 
approach had taken shape and a decision was. 
made that the extensive cooperation of the scien- 
tific community to bring the effort to fruition was 
likely to require a leader of Nobel-laureate 
stature. Consequently, ACS and NSF approached 
Dr. Glenn T. Seaborg, University of California, 
Berkeley, and asked him toassume leadership f6r 
the proposed revisions. Dr. Seaborg agreed, pen- 
ding the acceptance of Dr. J. A. Campbell, Harvey 
Mudd College, as Director of the project. A steer- 

^ The Foundation has had ^ long standing policy of appoin- 
ting some of its professional staff on a temporary basis ( 1-2 
years). The aim is to augment the capabilities of permanent 
staff by individuals who arc engaged in current research. The 
appointees generally come from academic situations, but oc- 
casionally also from industry and governmental 
organizations. The principles iirc somewhat similar to those 
in the Intergovernmental Personnel Act of 1970. 
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ing committee of experts was established and 
within a very short time this ^oup (with NSF 
support ) had developed a detailed plan for con- 
tent; had compiled lists of contributors, writing 
groups, and trial teachersynad set target dates 
and had completed an /outline for the initial 
testing of materials in mgh school classes. 

A formal proposal this plan was submitted 
to NSF for review, io^ received enthusiastic en- 
dorsement both from NSF staff and most external 
reviewers. Suggestions for revision were also 
received. NSF believed the revisions should be 
made and for^warded a commentary to Dr. 
Seaborg. The /changes were incorporated and 
following review by the Chairman and Vice- 
Chairman of the National Science Board an 
award to aditiate the curriculum development 
was made/ Subsequent amendments in excessgi- 
$250,000/Were reviewed by the fuU^pjapd-pt^^ 

award. | ^.S^^^^^ — 

In vie\ALjof4h^TnTen^elatio NSF staff, 

ACS membersip and the participants In the 
CHEM Study Project, suggestions of elitism, or 
the operation of a 'buddy system,' etc. might have 
been raised concerning the award of the grant, 
however: 

• - NSF was committed to selecting the best 

professional help it could find in initiating 
the effort, and it did so. 

• The major professional society in the field 
was equally concerned with and actively 
participated in improving curricula. 

• The r^SF reviewers and advisors, and major 
participants on the grant were acknowledg- 
ed experts and in(^ividuals who exemplified 
the highest professional standards and in- 
tegrity. 

• The participation of these individuals was 
an/ act- of service to scientific education. 
Salaried personnel were compensated at a 
no-loss, no-gain basis with respect to 
former jobs. None of the participants receiv- 
ed royalty income; this was remitted to the 
U.S. Treasury (except for $463,654 used by 
NSF) and in amounts which exceeded the 
original amounts awarded. Furthermore, 
the texts that were published do not carry 
the authors' names. 

An indcipcndent assessment of the success of 
the project revealed the following; 
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1. By 1965 the material had been adoptied in 
many parts of Canada, India, New Zealand 
and Australia. 

2. By 1965 individual films of the series had 
received 23 awards in major national and 
international competitions. 

^S:'By 1968 the material had been translated for 
use in 13 foreign countries. 

4. Between. 1963 and 1968, 10 new texts for 
high school chemistry were published., 
Seven of these reflected the combined in- 
fluence of the CHEM Study project as well 
as a second NSF-supported project. "The 
Chemical Bond Approach." 

5. The materials were widely and quickly 
adopted in U.S. .high schools and their use 
persists to the present. Some states have 
adopted parts as "required"; others as "op- 
tional." The minimal persistent use is es- 
timated to be on the order of 25 percent of all 
high school students. The CHEM Study 
materials, including revised versions and 
derivations, runs well over 60 percent 
usage. 



Review and 
Oversight History 

Mechanisms developed for review and over- 
sight of this project reflect traditional practices 
of the Foundation. NSF professional staff has the 
responsibility to stay informed on scientific 
progress in a field at both the national and inter- 
national level. By definition this requires ac- 
quaintance and communication with the scien- 
tists carryingout the worL Generally, a new NSF 
activity is initiated by the staff following 
thorough study and informal discussions with 
scientists. In response to complexity of thft area, 
experts are brought together in an ad hoc 
workshop or conference. Following its develop- 
ment, a concept is most often presented to a for- 
mal advisory committee for further deliberation. 

After a decision is made to develop an area, the 
Foundation uses a variety of mechanisms to an- 
nounce its interest in receiving and reviewing 
proposals; those received are then subjected to 
review by staff, external experts, and also often 
by panels convened to evaluate relative merits of 



several ph)posals. Proposals recommended for 
funding in new program areas are then presented 
to the National Science Board for review and ap- 
proval. Currently, there is a requirement that any 
award in excess of $500,000 per year or which 
carries a total obligation in excess of $2,000,000, 
must be presented to the Board for review. 

In the case of the CHEM Study proposal, there 
was*staff review as well as review by experts 
outside the Foundation prior to that of the NSB. 
""Thus there was collective consideration by some 
16-20 experts in addition to NSB review on the 
merit of the proposed curriculum revision; the ex- 
tent to which revision was necessary and the 
probable value for high school level education. 
Competence of the primary par':icipants was con- 
sidered and it was agreed that they would com- 
plete the project responsibly and with scientific 
accuracy. 

The role of the Steering Committee was one of 
the key factors that led to favorable reaction to 
the proposal and this committee was to persist as 
the advisory and policy group for direction of the 
project. It was composed of outstanding 
chemists, academic and industrial, from around 
the country and included educators experienced 
at the high school level as well as representatives 
of the textbook and film industries who provided 
guidance in business matters. 

This committee mechanism considerably 
lightened the burden on NSF staff for primary 
content review; the prime responsibility for 
selecting and evaluating content and accuracy of 
the material resided with the Steering Com- 
mittee. However, NSF closely monitored 
developments and participated in meetings of the 
Steering Committee throughout the develop- 
ment, revision and evaluation stages and thus 
had ample opportunity to represent its view- 
point. 



Contractual Arrangements 

In December I960, the CHEM study staff 
solicited, through the American Textbook 
Publishers* Institute, rough estimates and out- 
lines of capabilities from all parties interested in 
servicing, printing, and distributing the 
definitive edition of the textbook, laboratory 
manual, and teachers* guide. About a dozen 
replies were received and reviewed by the Steer- 
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ing Committee. Three companies were requested 
to submit formal bids based upon detailed 
specifications approved by the University of 
California. The Steering Committee and CHEM . 
Study staff then analyzed the bids and 
recommended that W. H. Freeman and Company 
be awarded the contract. Copies of the proposed 
contract between the University and W. H. 
Freeman were submitted to NSF for review. The 
Assistant Director for Education advised the Un- 
iversity's Graduate Business Office that the con- 
tract vyas satisfactory to NSF in all respects — 
substance, control of the content and utilization 
of the publications by the University and CHEM 
Study staff, and administrative, financial and 
legal provisions. 

Criteria for the selection of a publisher and dis- 
tributor were reasonable. They included con- 
sideration of the quality and style of the sample 
text submitted, experience of the publisher with 
textbooks, proposed working a^rangements, 
competence and policies of the publisher, dis- 
tribution function, and promotional facilities. 

W. H. Freeman also published and distributed a 
book, The CHEM Study Stbry., whose cost was 
charged to the grant. The contract was not 
awarded on the basis of competitive bids. CHEM 
Study staff had reviewed this matter with 
American Textbook Publishers Institute and was 
advised that the arrangement would not raise ob- 
jections from other publishers because of its 
limited distribution. 

Royalty income received from the sale of 
materials totaled $4,027,448, of which $3,563,794 
was deposited by NSF with the U.S. Treasury as 
miscellaneous receipts. The remainder, $463,654, 
was returned to the NSF Directors reserve ac- 
count; the program office, consistent with ex- 
isting NSF policy, had authorized the use of an 
equal amount of grant funds for printing 
materials with the understanding that the funds 
would be replaced from sales income. Such treat- 
ment of royalty income was a matter of inquiry 
by the General Accounting Office and subse- 
quently resolved by the NSF Office of the 
Geqeral Counsel and GAO. A new income policy 
was promulgated under NSF Circular No. 106,^ 
dated January 25, 1972. 

Almost from the beginning of the project, 
CHEM Study staff devoted much thought and 
discussion to the problem of how toijnaximize the 

^ A copy of this circular is found in Appendix A. 
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influence of the study without perpetuatinglthe 
activities of the project. Various alternativeslfor 
the disposition of the publishing rights and revi- 
sion rights were considered, including public do- 
main, outright ,9'-ie of all rights to one publisher, 
continuation of present policies without revision 
of the books, and authorization of two or more 
revisions. In July 1965, publishers were informed 
of the Study*s intent to invite proposals, for 
revisions of the CHEM Study Textbook, Lab 
Manual, and Teachers' Guide. • 

The major conditions in revision rights were to 
be granted to no less than two nor more than three 
publishers; selection would be based principally 
on the qualifications of the writing teams propos- 
ed, i.e., scientific competence, writing ability and 
teaching experience of the chemists and teachers 
as evidenced by their published works and 
reputations as teachers. Selection of proposals 
would not be based on financial considerations, 
but a standard flat fee was to be paid by the 
publishers selected for the rights. Three 
publishers were selected for revisions. Each paid 
CHEM Study $35,0.00 for the right to publish and 
CHEM Study did not collect royalties on the 
published revisions, 

A substantial number of companies were con- 
tacted to determine their interest in producing 
CHEM Study films. Producers were chosen on 
the basis of competence and willingness to leave 
substantive control completely in the hands of 
the Study. These contracts, for the production of 
films only, cost from $11,500 to $21,6r^0 each. 
There were no royalties involved, and the rights 
to the films were retained by the University. To 
obtain a distributor for the films produced and/or 
purchased, CHEM Study contacted 36 film dis- 
tributors, of whom 13 indicated interest; three 
were requested to submit formal bids. NSF ap- 
proved all negotiations. 

A draft ropy of the film distribution contract 
was submitted to NSF frtr review and comment. 
NSF advised the University of California that it 
had no objection to contracting with Modern 
Talking Picture Serviced. Inc. and the contract 
was executed February 19, 1963. Copyrights' to 
the films are held by the University of California 
but the U.S. Government may use or reproduce 
the ma'terial for governmental use without 
charge. 

Modern Learning Aids, the division of Modern 
Talking Picture Services which distributed the 
films, paid the University a 20 percent royalty on 
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net receipts from the sale or **lease-to-buy plan," 
and it paid a royalty of 5 percent on net receipts 
for films distributed under the "subscription 
plan." The contract was amended May 10^ 1968, 
permitting the xlistributor to distribute, in car- 
tridge form, film loops excerpted by the Advisory 
Council on College Chemistry from the CHEM 
Study films. The royalty arrangement for thedis- 
Iribution of the film loops was the same. 

Royalty income was remitted to NSF and 
deposited with the U.S. Treasury. 

It was recognized that perhaps the most impor- 
tant factor in selection of a film distributor 
would be the integrity and enthusiasm of the 
organization doing the job. Nevertheless, it was 
also necessary for the distributor to have in- 
ternegatives made at his own expense, purchase 
and slock preview prints, handle service rental 
orders and sales of prints, and to print and dis- 
tribute teachers* guides for each film. Further, he 
must /be prepared to distribute in eight 
millimeter, if feasible, and if requested by CHEM 
Study, would publicize the films on an aggressive 
basis and actively promote sales, would pay a 
royally on prints sold and on rentals, and would 
be responsible/for financial arrangements. 

Selection was based on an analysis of prices to 
users (sales and rentals), method of publicity, 
methods ^or selling and renting, services to users, 
other chemistry subjects being promoted, and 
royalties. Royalties were considered to beof least - 
importance. 

The latest information in the NSF files (March 
30, 1971) indicates that Modern Talking Pictures 
submitted a pricing policy to CHEM Study's Ex- 
ecutive Director for the 12 months beginning luly 
1, 1971. According to an NSF program official, no 
additional information has been received concer- 
ning the distribution of the CHEM Study films. 

Information contained in the Foundation's files 
indicates that the CHEM Study project was 
managed in accordance with NSF and NSB 
policies on distribu I ion, royalties, and 
copyrights, and that good business practices 
WT*re followed. 

Two examples found in the files reflecting NSF 
responsiveness to private enterprise can be cited: 

"The Foundation met with representatives 
of the publishing industry to includt; their 
views in terms of modifying the policy of 
assigning exclusive publishing rights. The 
meeting also consiciertid the problem oi 



availability of *non-commerciar materials 
during the testing period." 

"The Foundation in 1965 revised its policy 
of distributing free books to institutes in 
response to a request from the American 
Textbook Publishers Institute.*' 



Monitoring History 

NSF staff followed development of the project 
closely. Fiscal reports and annual reports of 
progress were required in the terms of the award. 
At a managerial level, the NSF staff was essen- 
tially in continuous contact with the progress of 
the project. Informal reports were frequent and 
advice on and confirmation of proposed direc- 
tions were given prior to undertaking the activi- 
ty. Questions involving selection of publishers 
and distributors, contractors, royalty income, 
etc. were forwarded to NSF legal counsellor 
verification of compliance with NSF and Federal 
policy. The pattern of advance planning with 
NSF feedback and subsequent action was firmly 
established in the CHEM Study project. The pro- 
ject directors, in turn, made conscientious efforts 
to keep NSF fully and currently appraised of 
progress and solicited advice on anticipated 
directions and problems. 

The NSF staff made frequent site visits to the 
central project office at Berkeley and to regional 
centers after they were established. They attend- 
ed planning and writing sessions as well as 
meetings of the Steering Committee. A CHEM 
Study newsletter W3S developed to inform the 
community of the group's activities and was 
mailed to school supervisors and teachers around 
the country. In addition, formal descriptions 
were published in a variety of educational jour- 
nals to reach an extended audience. 

Copies of 'final materials were received and 
reviewed hy NSF staff. Staff involvement in the 
project was complete, continuous and thorough. 
The staff was kept informed on program areas 
that proved troublesome or required revision. In 
some instances it became clear that previously 
unplanned supplementary material should be 
developed. Although some of the material had not 
been identified in the original request, 
modifications were incorporated wFlh NSF con- 
currence (e,g., A Progronim^.'d Sequence on Ex- 
poiu^ntinl i^oidlmn: A IVogramnit'd SeqiKMurc on 
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the Slide Rule.) In 1966, accounts were audited by 
NSF and only minor changes were required in ac- 
counting procedures concerning indirect costs; 
no improprieties in the use of furids were found. 

Evaluation of contiBnt was built into the project 
from the outset. The first draft of the text was 
written and put to use within three months. 
Teac^iers who participated in the writing also 
usedithe material in their classrooms. Additional 
teachers within a radius of about 50 miles of 
Berkeley used the text the first year. Reactions of 
teachers and students were fed back to the pro- 
ject director after use of a section so that 
modification and revision of the text was a con- 
tinuous process. Periodic meetings between pro- 
ject staff and participating teachers were held to 
.exchange ideas. 

By the second summer the text was introduced 
in several NSF summer institutes, and subse- 
quently in others sponsored by private, local and 
State groups expanding the roster of par- 
ticipating teachers. By the second academic year 
the text was virtually complete; the teacher*s 
guide was developed almost entirely as a result of 
suggestions from teachers. In subsequent years 
greatest effort was devoted to, development of 
supplementary material, again using the 
mechanism of testing, evaluation* feedback and 
revision. ' . 

A retrospective reviewer of this project is im- 
pressed by the efficient management and inten- 
sive dedication of the participants. During the 
development phase this meant coordinating the 
efforts of a large staff. 23 writers, 22 film 
collaborators; 15 center directors and more than 
130 trial teachers from 35 states and Puerto Rico. 
Suggestions for revision, problem areas, student 
.and teacher evaluations were assimilated and 
acted upon under the advisement of the steering 
committee and NSF. Deadlines were met. and 
copies of material were available for testing by 
the efid ol\^the first summer*s work. The final text 
was essentially ready after the-second summer, 
with subsequent efforts concentrating on lab ex- 
periments, specialized aids and teacher training. 

By 1963, NSF was giving considerably more 
attention to problems of evaluation associated 
(with course content development. Questions 
related to the soundne^^of the material, the ease 
of learning, apprjopriat'eness of sequence, etq. led 
to explicit encouragement by the Foundation of 
grantees to incorporate evaluation procedures at 
an early stage in the project's development. 



Implementation History 

It was determined early that materials produc- 
ed should be competitive with current texts and 
that the packaging should be flexible in order to 
allow selective utilization andeasy adaptation of 
both equipment and supplementary materials. It 
should be recalled that curriculum development 
and such ambitious revisions of material were 
highly innovative and experimental under- 
takings in the late fifties and early sixties. There 
were few similar experiences to draw from in 
terms of tested implementation practices. Policy 
discussions among NSF staff. Advisory Com- 
mittees and the participants on the project 
recognized that "product acceptance*' and utiliza- 
tion were the ultimate goal, for this effort. Yet, at 
the same time, NSF repeatedly reiterated its posi- 
tion that its funds could not be used for promo- 
tion and distribution of the materials and that 
selection of materials for use in schools resided 
with State and local authorities. Funds could be 
used for the dissemination of information about 
the project, and indeed the grantee was obligated 
to publish reports on the project in national jour- 
nals. 

One of the first films enjoyed great success and 
was shown to a wide audience by way of national 
T.V. The, participating staff- responded to re- 
quests for information by letter or by personal 
appearance. 

Early on, inadequate teacher preparation in the 
Sciences was recognized to be as much a problem 
as poor curricula. Indeed, the Foundation's 
attempts to correct this problem' had led to the 
developniem' of a fairly extensive summer in- 
stitute program well before the initiation of ma- 
jor curriculum revisions. Given this situation, it 
is not surprising that the NSF summer institutes 
lent themselves to becoming a vehicle for im- 
plementation. It should be noted it could not be 
predicted in advance whether GHEM Study 
material, or chemistry as a topic, would be a sub- 
ject for institute attention. Ghoice of material and 
the decision to submit a request were at the in- 
itiative of a given college or university. Grant 
awards were based on successful competition 
under the usual reviewing mechanisms. 

It is fair to state that the primary focus of the 
institutes was on equipping teachers with ade- 
quate information about recent developments in 
chemistry and only secondarily on acquainting 
them with the approaches and materials 
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developed by the CHEM Study program. 
Gradually, institutes adopted CHEM Study 
materials and as teachers became acquainted 
with the materials, they adopted them for use in 
classrobms around the country. 

Newsletters and publications generated many 
requests for consultant assistance in adopting 
the materials as well as requests for their use in 
other privately sponsored institutes. Con- 
sidering the experimental nature of this effort 
and the fact that methods of implementation are 
still a poorly researched area, the.utilization of 
the new materials was surprisingly effective and 
rapid. 

The Foundation recognized that in order for im- 
plementation to be more effective, the staCf need- 
ed to devote more planning to this phase and to 
think mofe in terms of ^'targeted" audiences 
rather than to maintain generalized approaches. 
Borrowing from the experience of the National 
Council of Teachers of Mathematics, NSF con- 
cluded that developing the awareness of key ad- 
ministrative personnel through a series of con- 
ferences would be eligible for NSF support since 
they would be designed to encompass the breadth 
of curriculum reform in an area rather than focus 
on a single development supported by NSF. 
than focus on a single development supported by 
NSF. 

Except for this initiative, no other formal im- 
plemeivtation mechanisms were considered for 
the CHEM Study Program. 



Potential probjem areas, 
policy issues and procedural 
matters requiring NSF 
attention 

The basic NSF policies and procedures 
associated with receiving and reviewing 
proposals and with grants administration and 
monitoring appear sound. As NSF has entered 
new areas of activity, these have been modified 
or new procedures have been developed. Not un- 
.expectedly, the changes have Some times lagged 
behind the new activity. Areas for possible im- 
provement in NSF procedures and policies 
suggested themselves. Of the following items, 1, 
2 and 3 could pertain to nil components of the 
Foundation. Item 4 is limited to tho Educntion 
Directorate. ^ 

i 

/ 75 

o 

ERIC 



1) There are very explicit conflict of interest 
statements for NSF employees. Board 
members and ex-NSF employees who seek 
subsequent Foundation support. Should 
NSF establish guidelines and advise, 
grantees as to similar considerations as 
they relate to Contracts through the grantee 
which are let to former participants on a 
given project? 

The possible need was identified by a situa- 
tion in which a major contract was let to a 
former project associate. The party had 
been disaffiliated from the project for more 
than a year prior to the contractual agree- 
ment. The act was executed with NSF ap- 
proval. However, discussions and expres- 
sion of interest on the part of the company 
had occurred within months of the resigna- 
tion. 

Question: Should the Foundation establish 
guidelines which would preclude the 
'appearance' of privileged status, conflict of 
interest, etc. fcr grantee contracts? Should 
. there be a m.andatory waiting period which 
precludes contracting with a participant for 
a defined period of time (there are obvious 
disadvantages to the Foundation in ex- 
ecuting its responsibilities if the period is 
too long, i.e., does one become subject to 
penalization for participating)? In such 
cases, should there be a special third-party 
review? 

A similar situation involved a minor^, 
purchase order let to a former project par- 
ticipant, who subsequently became re- 
employed by the project. 

Question: In the interest of maintaining 
public accountability, what guidelines 
should NSF issue to grantees regarding 
such practices? 

2) Size of the award. For most NSF grants the 
average size is such that annual progress 
reports are quite acceptable. 

Question: When the amount is large, e.g., in 
excess of $500,000/year, should NSF re- 
quire quarterly or semi-annual reports? 
Should site visits by expert consultants be 
required to monitor progress? Should there 
hti a rociuirement for an oversight com- 
mittee? To what extent should internal 



reports of progress to Assistant Directors 
be required? 

Any such policies should be flexible in that 
various installations require capital outlay 
or running costs well ir excess of $500,000; 
such investments shou.J be distinguished 
from the "project" grant and treated accor- 
dingly. 

3] Evaluation of progress. The weakest link in 
the NSF system appears to be at this level. 
The general principles and procedures used 
are adequate and in fact quite sound. The 
correction lies in their improved applica- 
tion. 

Two recent internal management^ in- 
novations (Long Range Planning and 
Program Review) have helped in this 
respect, but they are at best periodic and 
generally limited to major developments or 
new directions. 

This retrospective look leaves the clear im- 
pression that slippage in the monitoring of 
progress began to occur after the mid- 
sixties, during the period when staff in- 
creases did not keep pace with increased 



program responsibilities. (The same may be 
true in other NSF Directorates). In view of 
the heightened interest of Congress in. NSF 
matters and the resulting additional 
demands oq staff time, improvement in this 
area should probably be a number one NSF 
priority. 

This would appear to require developing a 
strong case for increased staffing, consul- 
tant and travel money or for other changes 
in management emphasis. It is not rlear how 
to devote more time to monitorini^j progress 
and improve monitoring and evaluation 
without additional resources. 

4] Materials developed in course improvement 
projects. Depending on an individual 
program director s interests, these may get 
greater or lesser attention and review. 

Question: Should there be a formal NSF 
review, including third party experts? It is 
important to avoid censorship, but perhaps 
the Foundation should have more 
systematic procedures for examining and 
reviewing materials. 



SCIENCE CURRICULUM IMPROVEMENT STUDY (SCIS) 

Science Curriculum Improvement Study (SCIS); University of California, Berkeley; $4,326,395 
(Includes grant of $40,250 to University of Maryland); 1962-1977 (proposed); Grades k-6 (originally 1- 
6). 



The SCIS project is focused on developing a 
framework of fundamental scientific concepts 
that are related to the student's own experience 
with natural phenomena. The attainment of this 
functional framework so that it provides a basis 
for assimilating further information is referred to 
as "scientific literacy." 

Staff at the project headquarters at the 
Lawrence Hall of Science, University of Califor- 
nia, Berkeley, include: the director, the assistant 
director, the director of Life Sciences, a coor- 
dinator, physicists, botanists, chemists, 
biologists, specialist teachers, research psy- 
chologists, laboratory assistants, production 
staff, research assistants, and secretar! s. Also 



numerous consultants have contributed to the 
development of the SCIS program. 

The Project Director is Robert Karplus, a 
nationally recognized research physicist. He ob- 
tained \rs doctorate at Harvard University in 
1948; wat h F. B. jewett fellow at the Institutefor 
Advances Study at Princeton 1948-50; served as 
assistant.^, .ifessor of physics at Harvard for four 
years, movo l to Berkeley as associate professor 
in 1954 and was appointed full professor in 1958. 
He has been a Guggenheim fellow and a Fulbright 
research grantee. He has spent one summer with 
the Elementary Science Study Project at 
Educational Services Incorporated (now Educa- 
tion Development Center, Inc.) in Massachusetts 
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and one summer on the Minnesota School 
Mathematics and Science Teaching 
(MINNEMAST) Project at the University of 
Minnesota. During the year 1962-1963 he was on 
leave from Berkeley and served as a visiting 
professor of physics at the University of 
Maryland. Karplus originated the project and has 
been a driving force behind SCIS from its incep- 
tion. 

Herbert Thier, an experienced educational ad- 
ministrator and an early experimenter with the 
SCIS program, has been the assistant director of 
the project since 1963. 

Chester A, Lawson, who left his position as 
research professor of natural science at Michigan 
State University in 1965 to construct the SICS 
life science program, served as director of 
development in the life sciences for SCIS until his 
retirement from the project in fall 1974. 

The involvement of a commercial publishei 
began in June 1966 when D.C. Heath contracted 
with the University of California, Berkeley, to 
publish the preliminary editions of the SCIS 
program; American Science and Engineering, 
Inc., was selected as the apparatus manufacturer. 
In 1968, D,C. Heath decided that it no longer 
wished to publish the SCIS materials. On 
February 25, 1970Rand McNally contracted with 
the University of California, Berkeley, to publish 
the final editions. All final editions except the 
kindergarten materials were published by 1972. 
The final edition of the kindergarten materials 
was published in 1974. Rand McNally retains ex- 
clusive rights to publish the SCIS materials until 
December 31, 1977, after which the entire 
program becomes free-licensed. 



Trial Centers 

To supplement the resources of the University 
of California at Berkeley, trial centers were es- 
tablished in New York at Teachers College, in Los 
Angeles at UCLA, at the University of Hawaii, at 
the University of Oklahoma, and in East Lansing 
at Michigan State University, 

The trial centers serve as an experimental 
facility for SCIS and the cooperating institutions 
in four distinct, but complementary ways. First, 
the additional experience with .the use of the 
materials by a larger group of teachers and pupils 
tests the reliability of the procedures and the 
. clarity of the communication with the teachers 



and pupils. Second, the in-service education ac- 
tivities in the trial centers serves as a pilot 
program for instructing teachers in the use of the 
SCIS curriculum. Third, all'evaluation programs 
of the trial experience provide material for later 
studies. Fourth, each of the cooperating in- 
stitutions associates the local trial centers in an 
appropriate way with its own educational ac- 
tivities. 

These centers have been jointly supported by 
SCIS, the local university, and the local com- 
munity. The centers operate their own programs 
with their local school districts, but are required 
to submit reports containing subjective teacher 
and student feedback oit the SCIS materials. 



Current Status 

SCIS has developed ungraded, sequential 
physical and life science programs for 
kindergarten and elementary school.. These 
programs involve 12 units for the elementary 
school and one unit .especially designed for 
kindergarten; Each of these units has been 
carefully evaluated by SCIS staff as it progressed 
from the early exploratory stage to the final 
published edition. The units were also tested 
several tirri^s in elementary schools throughout 
the Nation before they, were published. 

The units, which include teacher guides and 
student materials are as follows: Beginnings 
(kindergarten], Materia/ Objects, Organisms, In- 
teraction and Systems, Life Cycles, Subsystem 
and Variables, Populations, Relative Position 
and Motion, Environments, Energy Sources, 
Communities; Models: Electric and Magnetic In- 
teraction, and Ecosystems. The final units, 
together with evaluation supplements for each 
unit, were completed in the fall of 1974. These^re 
available at cost from the Lawrence Hall of 
Science, University of California, Berkeley, /A 
collection of six films depicting representative 
activities from both the SCIS Life Science 
Program and the Physical Science Program are 
available for rental or purchase from the Univer- 
luty of California Extension Media Center, 
Berkeley, California. 

The last date on which NSF funds were award- 
ed to the SCIS project was September 26, 1972. 
NSF has extended the expirationdate for the pro 
ject to December 31, 1977, with no additional 
iunds. This expiration date corresponds to the 
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termination date of the exclusive rights of Rand 
McNally to publish SCIS materials. 

The funding history for the SCIS project is 
given below. 



SCIS FUNDING HISTORY 





Award 


Expiration 


Award 


Grant 


Date 


Date 


Amount 


GE-600 (Univ. of Md.) 


10/26/62 


8/31/63 


$40,250 


GE-2914 (Berkeley) 


9/23/63 


8/31/64 


99.480 


Amendments to GE-2914 








1 


6/18/64 


6/15/65 


75,000 


2 


8/25/64 


6/15/65 


154.300 


3 


6/30/65 


10/31/65 


199.910 


4 


10/1/65 


6/30/67 


300.000 


5 


9/13/66 


6/30/67 


552.000 


6 


6/29/67 


9/30/70 


176.000 


7 


1/12/68 


9/30/68 


635.000 


8 


6/28/68 


9/30/69 


625.000 


9 


6/30/69 


9/30/71 


1.171.000 


10 


6/29/71 


6/30/73 


138.455 


11 


6/26/72 


6/30/73 


160.000 


12 [Extension of expiration date to September 30 


. 1974) a 



13 [Extension of expiration date to December 31. 1977) 0, 
-Total $4,326,395 



Description of the 
SCIS Materials 

V 

6 

Organization of Materials 

The SCIS program consitst of 13 units, six 
units for a physical science sequence, six for a life 
science sequence, and one unit, subsequently, 
dropped, designed especially for kindergarten. 
The unity of the physical science sequence 
derives from fundamental concepts of change 
and interaction. The six basic physical science 
unfits— Material Objects, Interaction and 
Systems, Subsystems and Variables, Reloiive 
Position and Motion, Energy Sources, and 
Models: Electric and Magnetic Interactions— are 
designed to introduce and develop the concepts^ 
considered necessary for scientific literacy. In 
the life science sequence the units focus on 
organism-environment interaction. The six basic 
life science units— Organisms, Life Cycles. Pop- 
ulations. Environments, Communities, and 
Ecosystems— make use of many scientific con- 
cepts, but focus on the special considerations ap- 
propriate to the study of life. The Ecosystems 
unit attempts to synthesize children's in- 
vestigations in physical and life science. The 
kindergarten unit. Beginnings was designed to 



develop children's powers of observation, dis- 
crimination, and description. 

The following table shows the seven levels of 
the SCIS program along with the concepts in- 
troduced in each unit. Either the physical or life 
science program may be used independently. 
Within the physical or life science programs, the 
units are designed to be sequentially presented, 
rather than as independent modules or com- 
ponents. Eac^ sequence of the six elementary u- 
riits roughly corresponds to tho ^-o grade level se- 
quence. 



Format of Materials 

The SCIS materials reach the classroom in the 
form of kits. The kits are designed to simplify and 
make convenient the use, s^torage, and re-use of 
the required equipment and supplies. Each kit is 
packaged for a teacher and 32 children and con- 
tains all of the materials needed except standard 
classroom supplies, such as crayons and 
scissors,, and the fresh-water organisms, which 
are sent separately when requested by the 
teacher. Each unit contains a teacher's guide.and 
a student manual. The teacher's guides include 
the following: 

1. An explanation of the conceptual 
framework for SCIS. 

2. An overview of the particular unit or se- 
quence. 

3. Suggestions for the teacher— explanation of 
the learning cycle, exploration/inven- 
tion/discovery; how to implement the lear- 
ning cycle; use of discussions, questions 
and feedback; the student manual; language 
development; and optional activities. 

4. Design and use of the kit. 

5. Major parts of the unit— series of chapters 
are combined to form parts of the unit. 
Preceding each series of chapters there is a 
list of objectives for that part of the unit, 
background information, an overview, and 
how the student manual can be used. 

6. For each chapter, learning objectives, 
teaching materials needed, advance 
preparation required, teaching suggestions, 
and optional activities aie described or 

sj n noted. 
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The Kindergarten and Six Levels of the SCIS Program 
With Major Concepts Introduced in Each Unit 



Kindergarten Level 

color 
shape 


Beginnings 

odor 
sound 


1; 

i 

quantity 
position 




texture 


size 


organisms \ | 






LIFE SCIENCE 
Organisms 


PHYSICAL SCIENCE \| 
Material Objects \ 


Level 1 


organism 

birth 

death 


habitat 
food web 
detritus 


object serial ordering ^ 
property change 
material evidence 






Lift: Cycles 


InteraF-tion and Systems 


Level 2 


growth 
development 
life cycle 
genetic 
identity 


biatic potential 
generation 
plant and animal 
metamorphosis 


interaction system 
evidence of interaction-at-a- 
interaction distance 






Popu/nlions 


/ Subsys loins and Variables 


Level 3 


population 


food web 


/ 

subsystimi solution 




food chain 
plant eater 


conimimily 
predator-prey 


evapori/tion variable 
histojjram 




aninicil eater 










Environments 


/ Kelative Position and Motion 


Level 4 


environment , 
environmental 
factor 


range 

optimum range 


1 1 r 
Ltference object polar coordmates 

/relative position rectangular 

relative motion coordinates 






Communities 


Energy Sources 


Level 5 


photosynthesis 
community 
food transfer 
raw n)aterials 


prod iicers 
consumers 
decomposers 


i 

energy transfer energy soi/rf;es 
energy chain energy receiver 






Erosystt.'ms 


Models: Electric Magnetic Interactions 


Level 6 


ecosystem 
water cycle- 
food-minernl 


oxygen-carhon 
dioxide cycle 
pollutant 


scientific model electricity 
magnetic field 



cycle 



The student manual is used as a teaching aid 
and is not designed as a mainstay of the unit . Dur- 
ing some activities, the students record certain 
information about their experiments in their 
manual, for later discussion. The manual also 
contains some problems for students to solve in- 
dependently, and some for class discussion. 

Cost of Materials to User 

Each complete kit includes equipment and con- 



sumable materials for the teacher and 32 
students. In both the physical science and the life 
science units some- materials and living 
organisms will be consumed during first use and 
must be replaced each time the course is taught, 
Also some of the units can be shared by two or 
more teachers. Each complete kit (1974 prices) 
costs between $125 and $280. Refill packages 
cost between $8.00 and $60.00 A complete set of 
the level K-6 SCIS kits would cosl approximately 
82,700. 
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Procedures for 
Using the P|X)r:uct 
Student Activities \^ 

The SCIS program is designeXto foster direct 
laboratory experiencesHFor~the student. The 
elem&H-tary classroom actually \becomes a 
laboratory. In their first exploration^ of a new. 
concept, the students manipulate or observe 
' selected materials, sometinries freely, sometimes 
.under the guidance of the teacher. 
' The SCIS units are designed so that students 
can complete "^ne unit per semester, or two per 
school year, provided they spend at least 45 
minutes per day. two days per week working on 
the units. While the objectives for each student 
activity are well specified in the teacher s guide, 
these objectives are never presented to the stu- 
dent. SCIS developers felt that presenting the 
student/with the objectives would hinder the ex- ' 
plorational and experimental aspects of learning. 
Studehts obtain feedback through group dis- 
cussions and interactions with the teacher. 
Motivation for the student is primarily intrinsic, 
e.g., working with live animals and real objects. 

Teacher Activities 

The effective SCIS teacher is a leader whose 
job is not simply to tell children about science or 
to listen to them while they read about science, 
but rather to observe and provide guidance to 
students while they are individually involved 
with science. The teacher uses the students* 
work, observations, and questions as a basis for 
planning subsequent science activities. The SCIS 
teacher should be sensitive, to the student's 
pregress or lack of it, and respond in a manner 
that enables the student to move ahead. The 
teacher provides conceptual **invent(ons,** but 
these are always followed by extensive oppor- 
tunities for student centered "discovery" ex- 
periences. 

The role of the teacher differs, depending on 
which stage of the three phase teaching/learning 
cycle is emphasized. Exploration requires that 
the teacher remain in the background, observing 
and occasionally answering questions. During 
invention, the teacher is more active. During 
discovery, the teachers role is primarily to ask 
facilitating questions and to respond to student 
questions in ways thatstimulate further inquiry. 

To teach the SCIS programs effectively, the 
developers recommend that the teacher should 



have sufficient background understanding of - 
science and the SCIS program to move with 
students along divergent, as contrasted to the 
more usual, narrowly focused paths. A strong 
emphasis upon in-service teacher training has 
been maintained by the developers at SCIS head- 
quarters in Berkeley and at the SCIS trial centers. 
Also in-service training programs, such as SCIS 
Awareness Conferences, Cooperative College- 
School Science Programs, and Summer 
Leadership Training Programs, have been (fon- 
ducted. j 

History Of SCIS 
Development* 

During the late 1950's, following the launch 6f 
.Sputnik, numerous meetings of educat^ anq 
scientists were held throughout the Nation to di^- 
Quss the adequacy of the higtj^cnool scirencfe 
curriculum. Dr. Robert K^r^s, Professor ot 
Physics at the Unjyefsity of California a^, 
Berkeley, attended several of these^meetings and\^ 
was impressed by the complaints made by the ] 
high school science teachers present. These ^ 
teachers were irrit^ted and concerned by how un- 
prepared in science their students were when 
they entered high school. / ' 

At this time, Karplus waal becoming reac- 
quain'ted with* the public scnools. Two of his 
children were in the early elementary grades and 
there was a desperate need £ t their school for 
someone to help in the teaching of science. 
Karplus was invited by the school to participate 
in "show and tell" sessions. a\\d found this par- 
ticipation to be a very rewarding experience. 

After hearing the high, school teachers' con- 
cerns about inadequate preparation of students 
and having personally taught in elementary 
school classrooms, Karplus concluded that there 
was a great need for improvement of science in- 
struction at the elementary level. Therefore, in 
the summer of 1958. Karplus and a group of 
colleagues at Berkeley submitted a proposal from 
the Orinda Union School district to NSF entitled 
"A Proposal for Research and Action'in the Field^ 
of Elementary School Science Teaching injhe 
Jrindci Union School District." Orinda is l(5cated 
near the U.C. of Berkeley campus. The proposal 
requested $150,000 for the period April 1959 
through June 1962. 



* S<M» Ki^iin« I for n fli)w diji^mm of Ihn miijnr ovKnts in the 
history of the SCIS projiMit. 
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MAJOR EVENT FLOW CHART 



Karplus'Participation in 
Public Elementary Schools 



Meetings on High 
School Science 



T 



"1*^58 



Need for Elementary School 
Science Recognized 
by Karplus 



T 



Proposal from Orinda School 

District to NSF Developed 
and Submitted; Declined by NSF 



ESSP Proposal from Berkeley 
to NSF Developed, 
Submitted, and Funded 



Visits & Teaching 
in the Classroom 
: by KarphiS 



ESSP Proposal at U.C.. 
Berkeley: Devel> ped, 
•Submitted & Funded 



-1959 



Development of 
Several Science 
Units 



. AAAS Feasibility 
rConferences on 
Elementary School Science 



Karplus\Ye2r Sabbatical- 
Studied Bruner and Piaget 



-1960 



NSF Includes Elementary 

School Science in its 
Domain of Responsibility 



Karplus Taught in 
Classroom— Examined 
Teaching 



-1961 



Karplus Broke with ESSP 
and Formed New Group 
Called SCIS 



I 



Karpius Vas Consultant 
for tiS & S:APA 
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& 




ESSP. Faltered 



r 



SCIS Proposal at 
Univ. of Maryland 
Funded by NSF 




Karplus— Leave of Absence 
to Univ. of Maryland 






t 








Karplus— Personal 
Exploration Teacher 
in Elem. Classroom 












Karplus— Worked 
With MINNEMAST 












SCIS idewsletter 
Published 


SCIS Proposal at 
U:C.. Berkeley 
Funded by I^SF 













1963 



I 



-1964 



SCIS Proposal from Teachers College 
Declined by NSF; Resubmitted Proposal 
from U.C., Berkeley Funded by NSF 



T 



SCIS Proposal at 
U.C., Berkeley 
Funded by NSF 



D.C. Heath 
(DCH) Selected 



ExperimeTital T^'ching: Organisms: 
Subsystems and Variables. Trial 

Edition by SCIS: Material 
Objects; Interacti on and Systems 

1 ^ 



-1965 



Trial Centers 
Established 



SCIS Proposal at 
U.C.. Berkeley 
Funded b y NSF 

t 



Experimental Teaching: Energy 

Sources; Life Cycles. Trial 
Edition by SCIS: Subsystems 
and Vaiiables; Organisms. 
/ Prelimipry Edition by DCH 
of Material Objects 
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-1966 




L1966 




Y 




Experimental Teaching: Populations; 
Environments; Models. Trial 
Edition by SCIS: Life Cycles 
Relative Position and Motion. 
Preliminary Edition by DCH: 

Interaction and Systems; Organisms 



T 



SCIS Implementation 
Program Begun 



SCIS Proposal at U.C.. 
Berkeley Funded by NSF 



T 



Experimental Teaching: Communities; 
Ecosystems. JriaLEditionbySCJS: 

Populations; Environments; 
Energy Sources; Models. Preliminary 
Editions by DCH: Life Cycles; 

Subsystems and Variables; 

Relative Position & Motion 



Rand McNally (RM) 
"Selected . 



Trial Edition by SCIS: Communities. 
Pjeliminary Edition by SCIS: 
Populations 



Training Supported 
by NSF 



U.C./Rand McNally 
Contract 



SCIS Proposal at 
U.C.. Berkeley 
Funded by NSF 



Evaluation 
Workshops 



Trial Edition by SCIS: Ecosystems. 

Final Edition by RM: Material 
Objects; Organisms; Interaction and 
Systems; Life Cycles; Subsystems 

and Variables, Environments 



H 
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Evaluation 
Supplements- 
Development Begun 



Evaluation 
Supplements 
Completed 



End of RM's Period- 

of Exclusive 
Publication Rights 



H 




SCIS Proposal at 
Berkeley 
Funded by NSF 



Final Edition by RM; Energy 
Sources; Communities; 
Models; Ecosystems 



Final Edition by RM: Populations; 
Relative Position and Motion 







Science for Kindergarten 
Development Begun 




r 


Final Edition of All Units 
Published by RM 



Expiration of Project 
Support by NSF 



«0 



J 

\/ 



1970 



-1971 



Training ^dpported By 

NSF 



-1972 



-1972 



-1973 



-1974 



Li 977 
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In this proposal Karplus proposed to conduct 
experiments with the content, methods, and 
materials for elementary school science with the 
aim of establishing a comprehensive curriculum; 
to develop in-service training programs for Orin- 
da teachers; and tp identify gifted students. The 
proposal was declined by NSF. At that time, NSF 
fell that its support should take the form of a 
national effort developed by the scientific com- 
munity to improve school curricula cmd 
programs, such as the summer institutes for 
leachers\ponsored by colleges and universities. 

The NSFielt that it would be wise to wail until 
a comprehensive curriculum program had been 
formulated before considering small-scale 
variants like the one proposed by Karplus. 
Furthermore, up to this time^ NSF had only 
provided support to universities or colleges and 
did not entertain proposals from loci^ school dis- 
Irigls. 

— riimh"e~spTiTig^' ni ~ ;'i59, -KTirplus-submitted- - 
another proposal to NSF through the University 
of California at BerkAiley, rather than through a 
school district. Thjf- "Proposal for a Study of 
Course' Content Improvement in Elementary 
School Science,"..sugge5ted a durcait)n from July 
1959 through June ""19130, and j^equested total 
funds of S43,000. The project was funded and 
appears to be the fir: I NSF direct support for an 
elementary school science project. The project 
became known as the Elemervlary School Science 
Program (ESSP). It proposed to construct a con- 
ceptual framework for the elementary science 
curriculum, to. prepare sample jecichin^. u to 
conduct an evaluation of the effectiveness of the 
materials, and to adopt the materials for use in 
.training teachers. 

In June 1960, Karplus left for asabbatical at the 
University ^f Vienna, Luring his stay in Vienna, 
Karplus read several books and articles by 
Bruner and Piaget and began to reformulate his 
thinking about science education. 

In lune of the same year, NSF made an award of 
$58,3'"'^ to the American Association for the Ad- 
vancement of Science (AAASj-for the purpose of 
holding a series of conferences to explore the 
fd'asibility of a major effort to imprgve science 
courses in elementary and junior high schools. 
Three regional conferences of about fifty persons 
each were held'in St. Louis, Missouri in january 
1961; in Berkeley, C&lifowfia in February 1961; 
and in Washington D.C. in March 1961. Par- 
ticipants included scientists, leaders in educa- 



tion, and elementary and junior high school 
teachers. During these conferences, it was con- 
cluded that a major effort should be undertaken 
and that this effort should involve both course 
materials and classroom teaching. Recommen- 
dations were made that NSF support develop- 
ment of two or three major elementary and junior 
high science programs in the U.S. These rec- 
ommendations were published and widely cir- 
culated in an article in Science magazine, in 1961. 

Meanwhile, ESSP continued at Berkel^jy 
under the interim direction of Karplus' 
colleagues, subject to certain understandings 
between NSF, the University Chancellor, and 
Karplus. However, after his return to Berkeley in 
the fall'of 1961, Karplus felt that the direction of 
the ESSP project had been altered without his 
knowlecge. He felt that the project had taken an 
unpromising course that threatened to pin'en* 
his continuing according to his own ideas, it 
- appears^hat-K-arptus-eolleagues-beHe\M?d-tbHt— 
personal classroom participation by the product 
developers was neither essential nor desirable, 
and Karplus held Strongly to the opposing view. 

Although NSF had provided funds for ESSP to 
continu e during the 19 61-62 school year, Karplus 
felt that he should star] his own independent ac- 
tivities. By the winter of 1962, he had completely 
dissociated himself from ESSP and had formed a 
new group called the Science Curriculum Im- 
provement Study (SCIS). 

By the fall of 1961, NSF bad officially.included 
support for elementary school' science in its do- 
main of responsibility. By the summer of 1962, 
NSF had" granted substantial funds to the 
Elementary Science Study /eSS) and Science: A 
Process Atrpr ocich (S: APA|. These were two ma- 
jtTT'SinHTrtnr'pr^^ resulting from the AAAS 
feasibility conferences. 

Apparently recognizing the need to reinforce 
the separate identity of the SCIS group, Karplus 
took a leave of absence from the University of 
California at Berkeley and placed the SCIS head- 
quarters at the University of Maryland where he 
was a visiting professor of physics during 1962- 
63. NSF provided funds for the project at 
Maryland in the amount of $40,250. Karplus used 
the year at Maryland to continue his exploration 
and teaching of young children in the elementary 
schools. At this time no SCIS units or products 
were being planned or developed. 
. The MINNEMAST project was funded by NSF 
in the winter of 1963 and became the third major 
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elementary school science program. Karplus was 
/ invited to serve as Director of Science for this 
project for^he summer of 1963 which allowed 
him to further develop and try his ideas. In the 
fall of 1963;> Karplus returned to Berkeley and 
received an NSF grant for S99,480 tocontinue his 
work on SCIS. At this time the ESSP project at 
Berkeley was faltering and apparently presented 
no obstacle to the efforts of SCIS. Also, by this 
time NSF had been supporting Karplus' ex- 
ploratory wgrk for four years and now wanted 
him to either plan on phasing out his exploratory 
work and expect nQ more NSF funds, or to put the 
SCIS project on a larger scale with a more perma- 
nent footing and with clearly specified plans lo 
produce materials. No SCIS materials had been 
produced since 'those originally developed in 
1959. Karplus chose the second alternative and 
the SCIS project moved from an exploratory in- 
vestigation to product developmen'i. 

— Seniw— S€ie«t4s-tsi — pers onaUy-oo m mtt^d— to- 

curriculum experimentation and materials 
production, were providing leadership to the pro- 
ject. A conceptual structure of scjence was 
V chosen to provide the framework - for the 
curriculum plan. The new materials were being 
tried in schools with teachers and chi)dren who 
were to participate in the development \ r after 
year. This development begun in the fall of 1963 
was completed, after several revisions, by fall, 
1974. Final editions of all 12 units (excluding the 
kindergarten units and evaluation supplements) 
were published by 1972. 

In December 1964, a proposal for support of the 
SCIS project was submitted by Teachers College 
of New York. Karplus was listed as a consjjltant 
to the project and^lso as the director. Apparently 
Karplus felt that he would be able toget more and 
bfltter support in the tryout and evaluation 
phases of his work from Teachers College of New 
York, than he could get a* Berkeley. It appears 
that he also felt that Teachers College staff in- 
volvement would be greater if Ihe institution ac- 
tually held the grant rather than merely acting as 
a source for an occasional consultant. 

The proposed arrangement was approved by 
both Teachers College and the University of 
California at Berkeley. Karplus was to continue 
as director of the project while maintaining his 
headquarters at Berkeley. It was proposed that 
reimbursement for services provided by the Un- 
iversity of California be made by purchase orders 
to Teachers College. 
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The Foundation declined to support this 
proposal, mainly because of the unusual ad- 
ministrative and business practices it entailed. 
However, in luly 1965 the NSF received a resub- 
mitted proposal for continuation of the SCIS pro- 
ject through the University of California at 
Berkeley. This proposal included establishment 
of four trial centers to assist in testing of SCIS 
materials and, with this additional provision, 
was funded. 

The SCIS project staff has spent much time on 
product development. From the early 1960's to 
thv! early 1970*s development of each SCIS units 
involved four major phases — early experimental 
teaching, trial edition, preliminary editions and 
final editions. On page 87 is a summary outline 
indicating when these phases took place for each 
of the 12 SCIS units (excluding the'kindergarten 
.unit). \ 



Analysis of Impact ^ 

The SCIS units and materials are presently be- 
ing used to some extent in almost all states. Es- . 
tirriates of student usage based on the publisher's 
(Rand McNally and Co.) sales data indicate that 
more than one million students or approximately 
3 percent of the elementary school population are 
now using the SCIS program. These students 
come from every socioeconomic level and are in 
both rural and urban school districts. The SCIS 
program has also been adopted and modified for 
use by blind children. It is anticipated that by 
1977 a minimum of 15 percent of the school-aged 
population will have been exposed to SCIS 
materials. 

The future of the SCISprogram will depend on: 
(1) whether or not school personnel are willing to 
spend a larger share of their limited funds on 
elementary school science; and (2) whether or not 
the teachers who will use the program are effec- 
tively trained. The major impact of the program 
is expected to be in the traditional classroom. 



Review and 
Oversight History 

From 1959 thrlaugh^December. 1970, formative 
evaluation, designed ' .to determine • the ap- 
propriateness of the SCIS science matetials, was 
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2. 
3. 

4. 

5. 



10. 



Early 

Experimenlal 

Units ♦ ' • Teachin^j 

Material Objects ^^i\2-iu\ 

Organisms 1904-60 

Interactions antl Systems 19G1-63 

Life Cycles l9G5-(i7 

Subsystem and Variables 1964 

Populations 19t)l)-t)7 ; 

Relative Position and Motion : . . 196l-l»4 

Knvinmmenls 19t)7-HH 

Energy Sources 19t)2-t)4 



Trial 

Editions 

Published 



Preliminary 

Editions 

Pliblished 



Communities 
Models 



19(i7-li9 
l9t)<i-tiH 



Nov. 1963; 
Sept. 1964; 
Aug. 1965 
Sept. 1966 
Oct. 1963 
March 1966 
Sept. 1967 
Sept. 1964 
Keb. 196t) 
March 1968 
[an. 1964; 
Nov. 1966: 
Sept. 1967 
Sept. 1968 
jnn. 1965; 
Sept. 1966; 
Sept. 1967: 
Feb. 1968: 
Sept. 19t)9 
Oct. 1909 
Sept. 1968 



12. 



Ecosystems 



1968-1969 



l^h. 197U 



june 1966 



Iune\1968 
july K967 

1968 
1968 

1969 

1968. 1969 



None 
None 



None 
None 



Final 

Editions 

Published 



March 1970 



May 1970 
May 1970 

Nov. 1960 
Oct. 1970 

july 1972 
May 1972 



Nov. 1970 
lune 1971 



luly 1971 
Aug. 1971 

-Angr-1^7-1- 



conducted by the project staff. 

Ideas for each SCIS unit were first discussed 
by the project staff, and through extensive for- 
mative evaluation procedures these ideas were 
translated into the activities, materials, and 
equipment for the units. The e^'aluation activities 
for each unit generally moved, from discussion 
and testing of the exploratory version to 
classroom trial, revision, and retrial: Public 
schools in Berkeley, California, as well as several 
schools affiliated with the -SClS-lrial. centers., 
provided feedback into this process. 

The information collected during the formative 
evaluation activities helped to determine which 
units were interesting to students, which were 
appropriate to the students' level, and which 
were producing the.intended learning outcomes. 
On the basis of this feedback, SCIS materials and 
equipment were revised and redesigned. Some 
unlLs were completely or partially rejected, while 
others were integrated into other units. 

In the spring of 1970 NSF supported a SCIS 
evaluation workshop, during which various 
feedback activities were compared and a mul- 
tiphasic approach to evaluation was designed^to 
fo-us on content and process gain, intellectual 
developmental stages, interests and attitudes, 
and teacher self-images in SCIS instruction. 

The development of evaluation supplements 
for the SCIS units were begun in the spring of 



1971 and completed in the fall of 1974. The miiin_ 
purpose of these supplements is to serve the 
teachers if they need external assistance to 
evaluate student performance. 

The SCIS staff has not and does not plan to con- 
duct a large-scale long term summative evalua- 
tion program. However, NSF does have plans for 
a summative evaluation of the SCIS project to be 
conducted by an independent third party begin- 
ning in 1977. 



Monitoring History 

in the early history of the SCIS project there 
appeared to be no regular pattern for NSF staff 
monitoring. Major interactions between NSF and 
SCIS staff appeared to he ve taken place only 
directly following the NSF receipt of annual SCIS 
proposals or when significant plans were 
suggested by SCIS to revise the budget. 

In 19*69\NSF engaged three consultants to per- 
form a substantive review of SCIS materials and 
procedures. The results of this review were used 
to provide critical inpiil to the SCfS'project direc- 
tor. \ 

NSF personneiXapproved the selection of all 
publishers/distribiilprs for SCIS materials and 
agreed to all contractual arrangements between 
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SCIS (U.C' Berkeley) and the pub- 
lishers/distributors. It appears that the selection 
of a publisher and the contractual arrangements 
followed sound business and legal practices. 



Disseminatlon/lrhplernentation Plan 

Interest in implementing the SCIS program in 
local school systems usually evolves through 
reading of the literature by school personnel, con- 
vpnlion presentations, or interactions with 
neighboring school systems. Based on dis- 
cussions with members of the SCIS project staff 
and/or the commercial distributors for SCIS, an 
overall plan for the long term implementation of 
the program in a local community generally in- 
cludes the following characteristics: 

- 1, A commitment is obtained from one or more 
school leaders to take responsibility fpr 



^ general administration, obtaining tundirigT^ 
making provisions for the necessary train- 
ing; and identifying themselves with the 
SCIS program 

2. A pilot run of the program in the school 
system is then made to determine whether 
lo proceed with large-scale implementation. 

3. Key individuals from the local school 
-system are selected by school authorities to 
carry on the leadership of the teachereduca- 
tion activities. Presently, such individuals 
are invited to att end the SCIS Implementa- 
tion Program at- Berkeley for a period of one 
week. Each one-week study visit is tailored 
to the interests and needs of the participant. 
The visitors participate in discussions with 
SCIS ' members, visit ^cla^srooms, and 
receive training on specific techniques for 
working with teachers in their own school 
districts. 

4. These teacher trainees then return to their 
local school districts and begin the task of 
training local teachers. / 

In the late 1960*s NSF funded numerous 
cooperative projects at universities for conduct 
of intensive summer/ training activities for 
teachers to include follow-up. in service 
assistance during the academic year. Some 
Cooperative College School Science|(CCSS) proj- 
ects were designed to train teachers' to conduct 



SCIS classrooms. Another dissemination activi- 
ty involved the publication of the SCIS 
Newsletter whi^h presently is published 
quarterly and currently reaches more than 25,000 
readers armually. 

In the summer of 1974, the NSF funded im- 
plementation projects throughout the country in 
the use of SCIS and other elementary science 
programs. Thirty-one of these projects, with 
1,600 participants, were devoted exclusively to 
SCIS, its materials, concepts, philosophy, anc 
teaching methods. Another forty-five projects, 
with over 8,000 participants, dealt with SCIS 
along with other NSF-suppbrled programs. 

Problems Suggested by Detailed Review 

1. There was an apparent lack of sensitivity on 
the part of NSF concerning selection of 
leviewers; there were no clearly delineated 
criteria for reviewer selection. 



2. Because of the highly interdisciplinary 
nature of the proposed SCIS project and its 
implication for change in schools on a 
national basis, the mail review system does 
not appear to be the best system, for 
proposal evaluation. 

3. There appear to be nb.specific provisions for 
parent involvement in the developTnimtiind" 
implication of SCIS. 

4. In the early history of the project, NSF had 
no well-defined system for monitoring or 

. evaluating its progress; appointment of out- 
side consultants by NSF helped correct this 
deficiency. 

5. The costs for fully implementing the SCIS 
program on a wide-scale» ii^cluding costs for 
teacher training and the SCIS kits, are 
generally higher than most school districts 
are able and willing to pay for elementary 
school science. 

6. Many schools are not prepared lo handle 
and organize all of the SCIS materials, es- 
pecially the live plants and animals. 

7. More coordination is suggested in monitor- 
ing all approaches to elementary science 
curricula. During early support of SCIS, 
NSF was also involved in the Elementary 
Science Study (ESS); Science: A Process 

(^Q Approach (S: APA); the Minnesota 
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Mathematics and Science Training 
"(MINNEMAST) project; and the Elemen- 
:^ry School Science Project (ESSP). From 
1958 to 1968 approximately 16 coordinating 
conferences involving the project leaders of 
all the NSF course and curriculum improve- 
ment projects were held. While there ap- 



parently were a number of coordination ef- 
forts carried out by NSF, there is still a 
question of exactly what role the Founda- 
tion should play in coordinating its 
curriculum efforts to minimize duplications 
and maximize effectiveness. 



COMPARING POLITICAL EXPERIENCES (CPE) 



Political Science Course Content Project for Elementary and Secondary Schools - "Comparing Political 
Experiences"; American Political Science Association, Washington, D C; $1,261,900; 1970-continuing: 
Grades originally K-12; presently 10-12 



The Political Science Course Content Improve- 
ment Project as proposed by the American 
Political Science Association (APSA) consisted 
-i nitially o f-4vv^— €omf)Qnenis. -One^- tha-JdigL 
School Political Science Curriculum Project, was 
to develop ^instructional materials for use in 
senior high school civics and government 
courses. The other, for elennentary schools, un- 
dertook a study of political science educaMon in 
elementary schools and. on the basis of this 
study, developed a set of guidelines for the 
production ,of new instructional materials and 
media for grades kindergarten through six. 

The materials produced by the high school pro- 
ject will be conceptually oriented, ii.ier- 
disciplinary in content, and will focus upon 
perennial problems and universal experiences in 
the political life of mankind. They are being 
designed for use either in conjunction with ex- 
isting curricula or as new programs in political 
science education. 

In early 1975, the decision was made by NSF to 
discontinue support of the elementary school 
project after the first year. The high school pro- 
ject material was in tryout in 1974 and second 
semester material is in preparation. 

Products to date include: 

First semester— Experimental version of 
teacher and student materials 

Unit I: Politics Here and Now 

Unit II: Political Resources 

Unit III: Political Activities . 

IJYiit IV: Four Political Experiences 
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Second Semester— 40 Page Outline 

The exact nature of publication is not yet deter- 
mined. It may be one hard cover textbook or a 

~s~eri*??5~DfnsepOTatenTrrihjr~ 



Development 

As early as 1963, when the determination was 
made that political science was potentially ap- 
propriatesubject material for theFpundation, the 
Director concluded that political science con- 
tained elements that were objective, verifiable, 
and susceptible to generalization. He further con- 
cluded that political science now employs— and 
essenti/illy to the same degree— a ''scientific" 
methodology similar to economics or sociology. 

In April 1970, the American Political Science 
Association (APSA) established a committee on 
pro-college education to consider how instruc- 
tion on government and politic?^ in elementary 
and secondary schools could bi improved. The 
committee*s report, ''Political Education in the 
Public Schools: The Challenge for Political 
Science**, proposed substantial reforms. The 
premise of the report is that the treatment of 
political science in traditional social studies tex- 
ts is seriously inadequate, that alternative 
curriculum material does not exist and must be 
developed. The report was based on results of 
small-scale surveys of students, teachers, and 
curriculum specialists. X 
This report was part of the APSA proposal 
received by the Foundation on September 22, 
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1971. after a July 1. 1971. inquiry from APSA and- 
a July 27. 1971, meeting between NSF and APSA 
staff. The grant' was awarded March 13. 1972. 
The Project Director is Dr. Howard D. Mehlinger, 
Director. Social Studies Development Center. In- 
diana University, He had produced a text on 
"American Political Behavior", published by 
Ginn & Company, available in the summer of 
1971 and copyrighted in 1972: The Co-Director is 
Dr. Richard C Snyder. Director, Mershon Center 
for Education in National Security. Ohio State 
University. 



Analysis of Impact 

Presently, there are twenty-five pilot schools 
using the course material, Thete are also fifty af- 
filiate s :hools which receive the materials but are 
only ir/ormally involved in the pilot testing, i.e., 
"thFschools are tree to useThe material and may or 



Monitoring History 

No site visit was made prior to the-award of Ihe 
grant in March, 1972. A site visit was later made 
to Indiana University at Bloomington on June 21- 
22, 1973, The availability of project personnel, re- 
/ qiiirements for schools and training of trial 
teachers were discussed. 

Interaction between NSF and project staff is 
generally in reaction to communication from the 
Project Director. Extensive program monitoring 
is not a practice followed by the program office, 
liut today's monitoring process represents a 
decided improvement over'that employed in the 
, early 1960's, Possibly because this project is in 
its early stages, there has beengreatercontinuity 
on the part of the NSF program office and 
reasonable attention has been given to monitor- 
ing the program. 

It is apparent that the^basic philosophy Tor 
curriculum development monitoring is that ma- 
f<>iu:eliance-is^5iaGed4m44ve-higli^ fied pro- 



may not provide feedback to the Project Director. 

A.t this time, no projection of ultimate use has 
been made nor is there any body of opinion from 
the professional community on the material save 
reviewers* comments generally favoring the 
material and recommending support. 



Review History 

The American Political Science Association 
was responsible for verification of the accuracy 
of scientific content as part of its activities in 
monitoring curriculum development. At later 
stages, comments were received after some* por- 
tions of the material were distributed to 
reviewers or summarized in renewal proposals. 

Judging froni comments of reviewers, the co- 
project directors were found to be highly 
qualified professiopals and there were no 
questions of their competency. Both were on the 
staff of academic institutions, JndianVi Universi- 
ty and Ohio Stale University, and had served 
respectively as Chairman and member of APSA 
Committees.on Pre-Collegiate Education. 

Although no conflict of interest appears to ex- 
ist in fact, the practicability of the primegrantee 
making the sub-awards to Jndiana and Ohio may 
be questionable from a managerial viewpoint. 



ject directors selected. Not unlike review ac- 
tivities on other grants, major reviews have oc- 
curred annually when . requests for additional 
funds are received. 

' No specific oversight committee was ap- 
pointed by the Foundation. The fact that the 
American Political Science Association was the 
grantee and had responsibility for overall coor- 
dination nf the effort appears to have led to the 
conclusion that the need for such a function was 
met. 

Page three of the proposal (on file) provide? 
background information on the oversight com- 
mittee appointed by APSA. Since APSA 
represents the scientific discipline involved, a 
question could be raised whether it would not 
have been appropriate to have an oversight v.om- 
mitlee independent of the professional society if 
" it were possible to obtain qualified participants. 



Dissemination/Implementation Plan 

Indiana University held a^publishers con- 
ference in july of 1974 to present four projects of 
the Social Studies Development-Center to poten- 
tial publishers. The University was furnished a 
copy of the Foundation s publication policy. This 
requires approval of plans to announce . the 
availability of materials to all qualified dis- 
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tributors as well as approval of the sel(?ction of a 
particular publisher; and f.nally approval of the 
proposed contract between the publisher and the 
grantee. The University plans a second con- 
ference in the fall of 1975 to present more 
definitive material at which time it will invite 
specific proposals frpm publishers. The dis- 
semination and implementation plan has not yet 
beien fully developed, but ii appears that it will 
conform to NSF requirements. 



Problems Suggested by 
Detailed Review 

1. In 1972, the practice was that a prr?essional 
association determined a curriculum nijed 
through a self-appointed committee. The APSA 
committee chairman and a member, then con- 
cluded that it would l)e appropriate for the 
j3rgjmizaliiJiiJ.o_S-U±imiLa.propQsaLLn.Lheir behalf. 



The award was then made to APSA for the work 
to be performed at Indiana University and Ohio 
University. In view of procedural changes, this 
practice may be questionable. 

2. APSA. in providing oversight for the 
development of the CPE curriculum as the prin- 
cipal grantee, believes it represents the interest 
of NSF. the Association and the user community. 
It is not clear how a single group, is-able to balance 
the interests of such diverse parlies, 

3. The rationale forseleclion of reviewers is not 
apparent nor documented, but the selection does 
seem to include representatives from sectors 
representing political scientists, educators, and 
school arlministrators. 

4. The level and the nature of monitoring con- 
forms to NSF practices and it appears to be more 
definitive than that practiced in other similar 
agencies, but there is still a question of overall 

ade(iu.:cy. 



MAN: A COURSE OF STUDY (MACOS) 



Man: A Course of Study (MACOS), Ediicotion Developmeni Contcr. Inc.; (EDCj formerly Educotionol 
Services. Inc: (ES/): Washington School of PHychiairy: Anlior.h College: others 

84.797,380 (Devolopment) EDC 

326.000 (Evaluation Washington School of Psychiatry. Antioch CoUegs'^ 

44.700 (History) EDC 

2.166.500 (Implementation) EDC. others 

^ S7.334.580 
1963-1,975: Grades 5-6 

" Development of the MACOS curriculum 
material was completed in 1970: projects on im- 
plementation and evaluation are cor.lirtuing. 

Information on NSF support of the curriculum 
developrrient. implementation, and evaluation is 
summ-irized in tables 1-3, 

In August 1963. the National Science Board 
was informed that the costs of developing the 
social science film project were estimated to be^ 
•about S2.5 million over a five-year period. By 
January 1965, the total requirements for a social 
science curriculum project were estimated to be 
about S4 5 million over a 20-morth period, an es- 



timate noted at the January 1965 NSB meeting. 
Development was completed by 1970 at a total 
cost of about S4.8 million over a seven-year 
period. 

The initial work, limited to social science films, 
was expanded to include social science 
curriculum . development. Early estimates of 
costs and time required were lower than actual 
requirements. The 'materials producT^d were 
designed primarily for grade 5; dovelopmeni of 
curricula for high school levels was not c{)m- 
plet\ul. 
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Project Description 

As described to the National Science Board in 
an August 8, 1963 memorandum, 'This project is 
part of a comprehensive plan for developing a 
carefully integrated sequential, social science- 
humanities program for elementary and secon- 
dary schools".^ 

A primary emphasis, was on producing 
ethnographic film studies to deal with the 
questions: What is human about human beings? 
How did we get that way? How can we be made 
more so? The curriculum was designed to in- 
troduce organizing ideas early and restate them 
frequently by the use of films of people in other, 
and apparently quite different cultures. Students 
were to be encouraged to learn to use 
anthropological and enthnographic methods and 
materials. 

'The secondary schools curriculum development effort 
was later dropped. 



Table 1.— NSF Grant Funds Awarded for 
Developmejnt of MACOS Curriculum and 
Evaluation, Fiscal Years 1963-75 



Purpose and 



Fiscal Year 


Requested 


Awarded 


DtivtAijpiiiciil 






1963 


195.000 


195.420 


1964 


618.315 


513.300 


19U5 


4.848.206 


300.000 


196U 




1.200.000 


1907' 


2.400.000 


1.738.000 


1908 


1.460.334 


430.000 


1909 


566.64f 


270.000 


1970 


527.005 


150.000 


T-iai 


10.810.500 


97.380^ 


Evalualjm 






1,970 


14.377 


14,0002 


1972 


463.581 


49.400^ 


1974 


595.160 


262.600^ 


Total 


1.073.118 


326.000 


1 iistory 


57.359 


44,700 



' Hdiii:atiiiniil SiTviiit's, Inc: Kdui:ntinn I)fv«lopnienl C«ntrr. Ini:. 
• WashinKliin Schoiit of Psychiatry. Wiishinxtiin. U.C 
' Anlinch Yeiluw Kprtnxs. Uhiu. 



Table 2.— NSF Grant Fui^ds Requested and Awarded for Implementation 



of MACOS Development, Fiscal Years 1967-75 






ESI 


or ED(:» 




Other Organisations 


Fiscal Year Requested 




Awarded 




Requested 


Awarded 


1967 35.538 




35.500 








1968 — 












1969 13,250 




11.000 




62fi.000 


445,000 


1970 — 








752.000 


445.000 


1971 — 








471.000 


387.000 










335.000 


196.00U 










NA 


152,000 


1974 331.000 




25.000 




NA 


260.000 • 


1975 is.noo 




10.000 




245.000 


200,000 


Total ..' ' 394.788 




81.500 




2.429.000 


2.085.000 


' Kiliir..itiiinal SiTvii:es !ni:iirpi)raU'(l; Kiiui.^ 


iittiin Ijc.'i.-liipnumt (Icnier. Ini.. 








NA • Nut .iv.tihililr 












H»!(vvm"n I*)»i7 .tnii 1*J75. ri-qm-s 


\s fro 


i^ KhC fur S3:il.(J0() anil fnim 


other orKiini/.alions for 
















Suurj.i': M.iIiTnl supjjlM'il hy ()flji:«; 


<if Assistant Uirpi:hir Kduciilicin. NSF 4':iri'7fi, 
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Table 3.— NSF Awards Directly Related to the Developmera of MACOS Curriculum^ 



Grant numher Titlu, i4istiluli(in. pri ncipnl invosti^;itor. amount, and duration • 

GE 18'Jl "Films on the Archeoloj^y and Elhnoyniphy of the Tehuacan Valley. Mexico." 

Educational Services. Inc. Michael Cot; (Yale University). $91,440. February 

18. 1968 - December 31, 1963 •. • • • • 

GE 2.^67 "Films on Eskimo Culture". Kducnlional Services, Inc. Douglas Oliver '? 

(Harvard University). S10'J.980. june 24. i96'J - August 31, 1974 

GE 3430 "A Social Science Film Program." Educationhl Services. Inc. Douglas 

Oliver (Harvard University). 5513.360 ending Dej:emher 31. 1964 

GE 3430-Al "Social Science (Curriculum Project". Educational Services, Inc. Elting 

Morison (MIT). j.S. Bruher (Harvard Univurjiity ). Franklin K. Pattt;rson 

(Tufts University). $300,000. through SepttMnjber 30. 1966 

GE 3430-A2 5600,000 through September 30, 1960 

GE 3430-A3 $600,000 through September 30. 1966 

GK 3430-A4 SlO.^i.OOO through September 30. 1966 ..... 

GE 3430-A5 5800.000 through September 30. 1968 Uiwrendp H. Fuchs (Brandeis University). 

GE 3430-A6 $833,000 through September 30. 1968 

GE 3430- A7 5430.000 through October 30. 1969 Lawrence l l\. Fuchs (EDC). 



Award 
Date 



3/.r)/()3 
1/29 ()3 
11/5/63 



3'19.-6r, 
10/1. (if) 
6M3'()() 
1 26 67 
32/67 
MO ()« 
1 1/26 68 



As reported in a 1972 brochure of CiiiTiculiim 
Development Associates, the publisher. Mnii: A 
Course of Study, the materials shown on the 
following list have been produced. 

Films 

'The I.ife'Cycle of the Si.lmon" |1() rnin.) 
"Herring Gull Behavior" 1 10 niin.) 
"Animals in .-Xinboseli" (20 niin.) 
"The Younger Infant" (10 min.) 
•The Older Infant" (8 nun.) 
"The Baboon Troop" [22 min.) 

"Miss Goodall and iiie Wild Chimpanzees" (:!{) min.) 

"Fishing at the Stone Weir" (30 min.) 

"Life on the Tundra** (14 min.) 

"At t.he Caiibou Crossing-Piaj:e" min ) 

"Autum River Camp." Part I (26 min.) 

"Allium River Camp." Part II (32 min.) 

"Winier Sea-Ice Camp.'* Part I (3Z min.) ^ , 

"Winter Sea-Ice Camp/* Part III |30 min.) 

"The Legend of the Raven" (20 ttdn.) 

"Knud" (31 min.) (Optional) 

BoGklets 

Life Cycle 

Animal Adaptation 

Information and nehavitjr 

Innate and Learned Behavior 

Natural Seleclirm 

Structure and Functijin 

Salmon 

Kf'rring CiiWs 

The Observer's llanjibook 

Animals of the African .Savanna 

Baboons 

The aaho(/ ; Troop 

Baboon r./t;imunij;atiJ)n ^ 
The Kieh. Notes of Irver D^Vore - 5 



A lourney to the Ar»;ti»; 
jSiiiigs a'iid Stories of Ibi! Nelsilik l!!skimos 
Antli?r and Fang 
The Arctic 
On Firm let! 

'I'fbe Many Lives ol Kiviok 
TJiis \\mU\ We Kni)W 
Trie True Play 
The Data Book 
7 Adilitional Animal B(i<iks 

Other Materials 

Wnills Rise Up (2-12" rfM.onis) 
In the Field (2-7" recJinis) 
5 fil^jistrips 

23 maps, posters and ptiotomurals 
3 (rduViatinnal games 
Kskitno carils 



Teacher's Guide 

9 books containing background information, bibiidgraphiel. 
suggestUl b.'sson plans, strategies for evaluat ion and a serie.s 
of in-servict: seminars for teachers. 



History of Project 
Development 

Needs Assessment. 

Diiririg Junt; 9--23 1962. prior, to iiny NSI* sup- 
port. Etiiicatinnnl Servicns. InC, sponsored <in En- 
(licott Hjoiisfi Conference in Dedhnni. Mfiss. . .to 
tlev(;lopiu:i uveraii iinifyin^^ approach that would 
providil giiidelino.ii for, structorinj^ of ii 
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humanilius and social sluclips curriculum run- 
ning through the entire elementary and secon- 
dary sequence,-" 

'The conference grew out oT conversations 
among Frederick Burkhardl, President. The 
American Council of Learned Societies, and 
Jerrold Zacharias, and Stephen VVhite, of 
Educational Services, Inc. (F^SI), The conference 
was supported by grants to ESI from the Ford 
Foundation, the Alfred P, Sloan Foundation, The 
American Council of Learned Societies, The New 
World Foundation, and the Kettering Foundation. 

Participants in the Endicott House Conference 
included some 61 persons representing social 
sciifnce disciplines plus those of law, history, 
physics, a:i(l education. 

A repor'. on the conference, /\ Narrulivc. Heport 
1D62''I^J.GA Sociul SluditJS Curricufum Hnjgrufn;, 
November 1964 concluded that,". . ,the teaching 
i;f the general field of social studies and the 
~hTrm"a n'i I ie's'WrTjrdTrs pe r atniy-rn-n etrd-trf improve- 
ment in the elementary and secondary schools of 
this country". The' report also n{)tes that the par- 
ticipants did not realize the timt;, effort, an(J 
money *that would be, recjuired to remeily this 
situation. . - 

Proposals from Educational Services,/ Inc. 
and the American Council of Learned Societies 
received by the Foundation on January/:L 1963, 
described a review of 250 existing .social science 
films conducted in August-Septemb)h>f 1902 by 
ESI and ACLS staff headed by Douglas Oliver 
(Harvard. Anthropology). - 

This review of films resulted in a number of 
criticisms: 

• Minimal involvement of social scientists 
leading to inaccurate and misleading 
generalizations and dubious tfichniques of 
documentation 

! 

• Emphasis on dramatic effects at the* sacrifice 
of presenting honest data in clear and une- 
qu'iv.ocal style ^ 

• Failure to provide for (jueslions or v.x- 
pii)rations by students 

• Misrepresentation of the spirit of scientific in- 
fjuiry in the social sfiiences 

- Thr (jiii)tatioi; ami nWwv ina'iM'iiil on ihmmIh asst'ssuH'iil nvv. 
■ from proposal l-l;i'4 :i7rj() I nun ivlmiatiunal .Sj>rvii;rs. Inc. and 
tht! Anurricaii ("ouncil ol I.rariu'd Sncjjjtirs an(l,r<'«;iMV»;(l by 
thi; K.jundation on lanuary :\, UMiM. 

' Thn <:orporatr naiiu* was \,\\i'V chanj^rd to Kducation 
ni!V(?lnpniMnt c:i:nlnr. Inc [MDCI Q 



•/ Failm-e to present informal ion so that students 
/ could work with it 

• Lack of imagination in the use of film as a 
medium. 

The p"oposal was to (leal with these short- 
comiugs by having films made by social scien- 
tists and reviewed by experts; by producing filnis 
that could be u^Vi} for children at all grade levels 
and could be edited for vievving by a general 
audience; by providing a flexi^jje format; limiting 
the films to data that could be best represented by 
film, leaving mu(dv to the sluden! to be inter- 
preted; and l)y experimenting with film* in- 
no\'ations. 

In ad(liti()n,'tw^o conferences on the problems of 
social science were supported by the Office of 
Education and the I'oundalion and sponsored by 
the P/esident's Scientific Advisory Committee, 
Discussions of issues by the NSF Advi,*^. ory Com- 
-Hvi t4ee — o n--C->o u-r s e^ — Co \U e n4- — l^mJ^riJ-vumerU- 
Programs and by the Division's Committee for 
Scientific Personnel and Education led to the con- 
clusion that there was an urgent need for course 
improvement in the social sciences. Recommen- 
dations were made that the Foundation support 
social science? curriculum development projects. 



Analysis of impact. 

The MACROS materials are estimated to be in 
use in about l,7v. J schools in 47 slates. Estimates 
of students affected range from about 200.000 to 
:J2H;()00. The materia^ls.are also being used in five 
Canadian provinces and in England, Scotland,- 
North Ireland, and New Zealand. One report-' es- 
timates that in 1970 the MACOS materials were 
being used by about 200,000 children and that the 
number Of sch{)ols using the materials had in- 
creased from about 37.^) in 1967 to about 1,700 in 
1970, \ - 1 

A review of the MACOS project files yiei.ded no 
systematic information on th(; extent of ar.lual 
use of the materials in schools. Materials on com- 
nnmily response are mainly newspaper* ac- 
counts, reports of very small-scale mail surveys, 

' I Vofiiofin,^ C/hjii^o ill; SWu)(>l.s. Kar \Vi;st La-horatory for 
I-;du(,alional K(;.sran;h and l)(!Vt;lupin(^nt, San Kranci.sco. HI74. 
p. 127. rrhr I'stiiiiaU; in thi' n«port that Uic , .200.000 
usrvs. . . n'prrscnt \H piMci-nt of I he niarknt" in in terror. 'I'lu; 
prrccnlawo sliould Uv. l.H, 
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to NSF Developed, 
Submitted, and Funded 



Visits & Teaching 
in the Classroom 
by KarphiS 



ESSP Proposal at U.C. 
Berkeley: Devel ped, 
Submitted & Funded 



-1959 



Development of 
Several Science 
Units 



. AAAS Feasibility 
rConf erences on 
Elementary School Science 



Ka r p |u s" y ea r Sa b bati ca 1 — 
Studied Bruner and Piaget 



-1960 



I 



NSF Includes Elementary 

School Science in its 
Doniain of Responsibility 



T 



Karplus Taught in 
Classroom— Examined 
Teaching 



-1961 



Karplus Broke with ESSP 
and Formed New Group 
Called SCIS 



T 



Karpius Vas Consultant 
for tiS & S:APA 




83 




.1962 



81 



ERIC 



— 



SCIS Proposal at 
U:c:. Berkeley 
Funded by I^SF . 



I 



SCIS Proposal from Teachers College 
Declined by NSF; Resubmitted Proposal 
from U.C., Berkeley Funded by NSF 



T 



SCIS Proposal at 
U.C., Berkeley 
Funded by NSF 



D.C. Heath 
(DCH) Selected 



ExperimeTital T^-chingrOrganisms: 
Subsystems and Variables. Trial 

Edition by SCIS: Material 
Objects; Interacti on and Systems 

1 ^ 



-1965 



Trial Centers 
Established 



SCIS Proposal at 
U.C., Berkeley 
Funded by NSF 



T 



Experimental Teaching: Energy 

Sources; Life Cycles. Trial 
Edition by SCIS: Subsystems 
and Variables; Organisms. 
/ Prelimipry Edition by DCH 
of Material Objects 

I 



-1966 






L1966 



ERIC 



-1969 



g Supported 
y NSF 



legional 

'mentation 

Centers 




1970 



970 



ERIC 



or anecdotal information. These materials do in- 
cicate that MACOS was a subject of controversy 
as early as 1971 and that certain NSF projects 
dealing with the social sciencevS were a matter ol 
cautionary Congressional comment in August 
1964. 

Thus» from the materials available in this 
review, there is no sound basis U)r making valid 
estimates of the extent of the use of MACOS 
materials over lime or of the impact of the 
MACOS curriculum on th(? places where it was 
used. 



Review History. 

Does the proposed iubject matter fit within 
reasonable limits or norms with respect to 
educational value? 

i:stimat(js of the need for thi; development of 
curriculum thai led to the tievelopmtmt of 
MACOS maltM'ials were based on a major con- 
ference of expert.^ in social science ami in tiduca- 
tion aftiir revicivv of existing social science films 
of about a decade ago; on two conferences spon- 
sored by the then President's Scient ific Advisory 
Comaiittee; and after encouragemimt from ad- 
visory groups to ihv. NSF Education Hirectoriite. 
Prior to suppcjrt of MACOS related projects, NSF 
had supported the development of secondary 
curricula in anthropology, Fach major MACOS 
related award was subjiict to pv.vs review and/or 
staff review ami submitted, as riivised on ihv. 
-l)asis of those ri^views, to the National Science 
Board for approval. It appears, then, that in the 
judgment of scientific petir reviewers, represtMi- 
tatives of the educational C()nuriunily. staff of the 
Education DinMiloraKN and t h/f*NaTffmal Science 
Board that the proposed subject matter did fit 
within reasonable limits or norms with rcjspect to 
educational value. 

Is the scientific cont(\nt accurate? 

Peer niviews of M ACOS-rfdcil(Hl [)roje(:ls in- 
dicate that [hv.vr. was little question libout (he ac- 
curacy of the scientific contijnt of materials thut 
would be produceil. It <ippears thnt Ibis judgment 
of piier niviewers wa>i based primarily on their 
eslimjile of ihv. competence and e\p(?rien(;(J oi 
lbos(! who were to be conducting th(j |n'oj(!Cls, 



Were course developers responsible and compe- 
tent persons? 

The judgmiMits (ixpressed by pv.iu^ reviewiirs 
and by NSF staff w(M'e that those responsibi(? for 
tiie cnurs(J development were responsibU; and 
competent. 

Were institutional and contractural 
arrangements sound? 

^.-^In December ISUiB, ESI presented the Kith 
grade materials lo 70 publishers, A general 
nuMiting to which 58 publishers were invitiid to 
consider possible publication of MACOS Hfth 
gratie material w<is held on June 16, 1907. Subse- 
cpiently, 4;^ |)ot(Mitial puoU^iers wv.vv. personally 
contacted by a senior of ficials^the organization 
umier its new corporate n<nmN F^duccition 
Development :::enter Inc, (EDC). ThTrpublishers 
contacted evidenced varying degrees of interiist 
but for the most part, decliniid the o'j:)port unity 
because of an EDC requirement for teachtir train- 
ing before use of the material as an intiignd part 
of any publishing agreement. In addition, 
publishers vveri! hesitant because of the limiltMl 
poliMilial for profit and b(M:aujie the plan involved 
inulli-metiia (ulucational mattjrials.. 

AmendmtMit no. H to grant CE 3430 was award- 
ed June 29, UU>3 to EDC for initial publication in 
the anticipation an accept abh? comnuMciid 
puf^lisher would be secunMb A revolving fund of 
S27^l()()0 was established for this puri)ose. It 
provideii for \hv. tiistribution of 1.000 s(!ts of 
niattirnils consisting of films, teachtM's' guides, 
games, etc. The income rectnved by EDC was sul- 
ficitmt to offset all costs agjiinst th(! grant which 
wiis subsequently cancelUnl by NSF, . 

EDC continutKl its search for a publisher of thi? 
(Hiucalionid matiM'ials and in lf)70 carriiid on 
^ serious negot iat ions with four potiMitial 
publishers: Initial Teaching Alphabet (ITA), In- 
s tract ionid Servic(\s I ncorporat (id (ISl). 
Wtjstinghouse Liiarning Corporation, and 
Curriculum Developmtmt Associates (CDA), 
Each of th(? fburpubli,shers was fully ini'oruuid by 
IvDC of [hv. conditions of the (Hintract, On March 
f), 11)70, officials of EDC requesttul NSF approval 
of its inteni to sel(M:t CDA ns ihv. conlrnctor for 
publishing educational mat(M'ial of MACOS, 
NSI' appr()V(Ml {hv. selection of CDA in a letter 
dated March 13. H)7(). 

( )n May 22, 1U7(). EDC submitted to NSF a drnft 
publishing .igri'.ement betwiMin EDC] and CDA. 
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The transmitting letter stated: 

"CDA recognizes thiit a unique tiisscMUination plan n\ust \n\ 
■ developed in order to introduce the courst!. CDA tlnirntove has 
requested EDC to assist in certain continuing activities; 

1] Maintaining liaisfui with schools and school systems, 
collage and university pre-service training* programs and 
with appropriate privat(! and governmental a«en(:i(!s con- 
ceined with curriculum and staff developfiienl. 

2) Identification i)f present or prospective iistMs ol llie 
work and leadership teachers trained in summer institutes. 

3) Assistance in .the ilevelopuunt of teachvr-t raining 
'proj»rams [holh in-servii:e and pre-s(;rvi(:e). 

•I) Joint development of a cmnmunications and information 
exchange amt)n« educatiim institutions usini; the work. 

5) Revision, modification or supphjmentation of tin; work. 

6) Continuing rtisearch .>.n(l evaluation of the e\t(?nt to 
which the w<irk is accomplishing^ its objectives. 

C:OA and EVC will thus be partners in the dissemination 
and pr()ni(jU.(lll. .ejfc Island. C'UA proposes to contr.ict 
separately for {-.DCs services. This will be done by 
negotiating (juarteriy paytncMits to KUC based upon one half 
of CDA's dissemination and promotion bud^fit which in no 
case will be less than the normal commercial dis- 
seniinalion promotion budget for multi-media materials of 
this type." 

Included in the draft publishing contract on 
page 4, itcni 4 (a) was the provision that CDA 
was: ( 1 ) To provide or arrange for, in cooperation 
with and in a manner satisfactory to EDC, 
teacher-training programs for prospective users 
prior to their adoption of the vvork and in-service 
teacher workshops subsequent to adoption of the 
worJ<; (b) explore new methods of teacher- 
training in an effort to expand the use of the work 
in pre-service as well as in-service programs." 

This draft agreement was reviewed by the staff 
of the Education Directorate, Office of the 
General Counsel and the Grants Office. There is 
no evidence in the files to indicate whether or not 
the transmittal letter from EDC accompanied the 
draft contract when it was reviewed by the ap- 
propriate NSF offices. The Assistant Director for 
Education at that time gave NSF approval of the 
draft contract on July 7, 1970, The draft contract 
as approved was signed by representatives of 
EDC and CDA on July 20, 1970, During the course 
of the review of the MACOS project a copy of a 
second agreement was obtained on April 15. 
1975, from the files of EDC. This subcontract 
provided the detailed working arrangements for 
Section 4(a) and (b) in the contracl approved by 
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NSF on ]uly 7, 1970. The service contract provid- 
ed for staff services to be furnished by EDC for 
which CDA would pay EDC '*one-half of its 
promotion-dissemination budget which in all in- 
stances will be ecjual to or greater than that 
which prevails in normal commercial practice; for 
the dissemination of multi-media educational 
materials." 

In the coui'se of this review, the program con- 
tract file was checked by the team to determine if 
NSF review and approval of the second agre.a-^ 
ment was documented. There was no document^- 
t ion of this item nor was tYiere a copy in NSF Tiles. 
It appears that this subcontract. did not require 
Foundation approval under the policy in ex- 
istence at that time and would not have been re- 
quired under existing practices. The Foundation 
had actually approved the arrangement, of which 
details were spelled out in the service contract, 
by signing the draft publishing contract on July 7, 
1970. 

The basic grant GE 3430 and each of its 
amendments contained in fact or by reference a 
standard NSF royalty income clause to the effec.t 
that separate accounts were to be maintained and 
use of income authorized by NSF, 

Because of the nature of the MACOS project 
and the teacher training requirements which 
EDC rtiquired being written into the contract, the 
task of locating a suitable publisher was dif- 
ficult. The contractual arrangements between 
EDC and CDA which finally evolved, though 
somewhat at variance from the norm, appear to 
be fiscally sound and adequate for the purposes 
intended. 

The proposals that led to the development of 
the MACOS curriculum submitted to NSF on 
January 3, 1963 by Educational Services, Inc. and 
l)y the American Council on Learned Societies re- 
quested $284,200 for ^he preparation of 
anthropological films. Sections A through E of 
each of the four proposals were identical and the 
proposals so stated/ They differed in the content 
of Section F which proposed film production in 
four distinct cultures. 

All four proposals were submitted to peer 
review. Awards were made for two projects 
(tables 1-3) the other two proposals were 
withdrawn in August 1963. The awards did not 
involve either policy issues or levels of funds re- 
quiring NSB approval. 

On the advice of NSF staff, the sam^ grantee 
organi/.ations submitted a consolidated proposal 



-:.|wquesting $618,315 for additional work on the 
two projects that Had been supported and for in- 
corporating* work described in the two proposals 
that had been withdrawn. This consolidated 
proposal was not submitted for additional peer 
review; NSF staff recommendations for support 
were based on results of peer evaluations of the 
earlier separate proposals that had been review- 
ed. The staff recommendation for support, at a 
reduced budget level, was submitted to and ap- 
proved by NSB. 

All subsequent proposals for continued sub- 
stantive work (Amendments GE 3430 Al, A5, 
and A7), received peer review and review by NSF 
program staff. In each instance, the program staff 
summarized the major issues raised by reviewers 
and made recommendations for support to senior 
staff of the Directorate. In each instance, the 
recommendation was a reduced work plan at a 
- lower level of effort than had been proposed and 
was submitted to and approved by the-National 
Science Board. Information on reviews of the 
proposals is contained in Table 4. Final 
recommendations reflected the adverse 
.criticisms of reviewers and staff analysis of the 
needs and status of the project. 



Monitoring History 

Monitoring of the MACOS projects appears to 
have taken the fonm of peer review and staff 
review of the proposals submitted for specific 
work erements. These reviews resulted in 
modifications in the budgets requested and oc- 
casionally resulted in modifications in the scope 
of work. Only two site visits are recorded during 
the course of the MACOS curriculum develop- 
ment. Major responsibility for the conduct qf the 
work>Yvas with the principal investigators and 
the planning committee of social scientists and 
educators assembled by the grantee. 



Dissemination/impiementation Pian 

Major difficulties were encountered by EDCin 
developing and carrying out dissemination and 
implementation of MACOS curriculum. When 
the course came on-line, as indicated earlier, EDC 
encountered strong negative reactions from 
potential publishers about marketing MACOS. 
The publishers believed the program had four 
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Table 4.— Summary of Review of MACOS-Related Proposals 



Reviewer c:hanir.UM-istir:s C,\- IKM Amend.mnls^' 
and R.M:c)nimen(lali.>n.s OK 1^507 CK :M :i 0 ■ «^ 



Affilialion 

Cnlle^L' and University • ^ 

Slati? Educalion A«rni:i(fs ~" 

Elcnienlary or Secondary Schools ~" 

Other nonprofil : ^ 

Federal ajiency. non-Al) K 1 

Discipline? 

Anihropolpxy ^ 

Edunution 

Sor.ioloj^y or Social Psyi:hol()^y 

Economics • 

Recomniendalion 

Support n.s submit lud / 

Support, with reservations " 

Da not support 

Aml)i«iH)iis "J 

Total Number of Reviewers ^ 

■Ttiepropos;,llis.(iin« vv.ir.l CB :J4:u) w... nnt , .-vlas r.l su.h R.-vl-w .is Ims.mI .ttn.v.Uti.it 

..ff«nrv.irl,''rprnp„s..lHlti.il m..lml.Mt wn. 1^ tn- .Inn. ...hUm ( :K J4Jn..nJ ih.ir n-sulmi in snpp..rl uf ( ;K 
IHUl .mil C.K li.Hr.7. 

.•TvvMiM.rsnnsr.n,rue.l..inhr-M»ni|>ys.'l-'';M-M.I..,.uK p.vs.,,, r,v i.vwMi uvn „l ihr tl.r..- pmpus 
eil ttnn*niln«'nts. 
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major liabilities thai made markutinj.^ it a risk of 
capital, time and personnel: 

• llnconvtiHtiona! i:on(:oi)ls 

• The need for spijcial teacher (M.lucati(m 

• The internihUednessof mi?dia with function 

• The cost of [hi) program. 

In 1909 and 1970 (prior to V.DC ilhtainin^^ the 
scirvices of a pul)lisher) NSK supported a small 
number of regional centers (six in I9()9, fi\'e in 
1970, four in 1971) ihrout^h th(? ronnilation's 
Course Content Improvement Program. The total 
cost of thes(? centers ranged from 8445,200 in 
1909 tt) 5154,900 in 1971. The centiM's w'v.vv. 
stratci^ically located in univ(M'sities and c{)lU?»^es 
in Florida. ()re«;f)n, Colorado, C'()nnect icul . New 
York, and olhtir stat(JS. The purpose of these 
renters was to furnish information conctjrnin^i 
the MACOS curriculum in the S{:ht)ol tlistritits of 
the region. VVh(;n the iU?sir(? was tjxpn^ssetl to use 
the MACOS curriculum, appropriate teiicher 
training was prtjvitletl by the centers. Th(?se 
renters were dis{;{)nt inuetl sh{)rtly after 
Clurriculum I3evelo[)ment Asstu'.iates (CD A) (.on- \ 
Iracltul to publish ami tlisseminatt? MACCS 
(Hirricuhim. 

B(M:ause of the innovativt? naiur(? ard un- 
conventional concepts of thii course. KDC f(?lt 
stront^ly that teachi»rs should rec(?iv(? specific 
training prior to tejichini^ MACOS in I hv. schools 
and had made this a retjuiremtmt for publishing* 
the course. When CT)A contra(:tetl with HDC as 
publisher of MAC(3S, it tlid so with the un- 
derstanclinjj that EDC's purpose and desire 
would be carri(;d out "to maximi/e, proce(!din^ 
now as rapidly as possibhr, th(! iliss(?minat ion of 
Man; A Coursu of .Study/' and "to achieve this 
maximum dissemination, at the same time, on a 
basis that is consistent with th(! tiNichin^ and 
learning principles that charactijri/.e the Cnurst? 
and that will assure so far as possible the con- 
linuinj^ opportunity to develop thos(j principU;s 
further." In atldition CDA officials stat(ul that 
they vv(}ald "be insistent on a mirihotl and 
program of dissemination which provides the 
teachers who use the (;{)nrs(i with full exposure to 
the use potentials conceived of by those who have 
developed it;" and would "seek a financial 
nrrangemimt which providcjs maximum opf)or-. 
tunity for further devcdopmfuit by the Ce/ihT of 
this and othcir ttiaching-hsuning cours(»s," . , 



C^^A was given full responsil)ility by V.DC to 
tl(»v.?lop the product ion and diss(?minal ion 
pr(4gram. ('HA proc(u?d{?d to establish targets for 
the {lisseminati{)n of class s(?ts inuniidiattdy upon . 
signing [ho publishing contract in 1970. At (hat 
time, the goal was on the order of 450,000 
stullenfs using th(? course in the 1972-73 sidiool 
year. 

In carrying out KDC's desire to make teacher 
training an integral part of the package, ihv. CDA 
Pvii.v. Information ShtnU for mat(?rials (h?V(dop(?d 
for MACX)S contains ihv. statenuMil, "All ord(?rs 
for classroom Or film materials are subject to 
\ (M ification by CJDAthat tin? purchasiM' has i:{)m- 
pil(5(! with l(?a(dier (?ducation retpiin?nients 
necessary lor proper imphuntMitat ion of the 

NSF pro\ ided support for teacher training for 
MACCS through its Sumnu?r Institutes Program, 
its Coursi; Content Improvemmit Program and its 
C:ooptMaliv(? College School Program. Beginning 
in FY 1974, NSF supportetl sp(M:ific implementa- 
tion proposals relating to MACCS, principally as 
part of larg(?r, comi^rehensive project s. Tlu^siMm- 
pUiUUMitation grants vary considerably, in th(? 
t yp(? of training and the target community. Por in- 
stanct!. support \ari(?s from awarentfss con- 
lerences ly leaidier-cenlercjcl projctcts which hav(^ 
built-in eviduation compomuits. As with most 
curritadum imphuiientat ion (d'forts, a multiplier 
eff(M:l is consiiUn-etl highly desirable; trained p(^r- 
soimtd are exptictetl to return to their school dis- 
tricts and train oth(?r tea(di(M*s in the effective 
ti'aching oi* thtj MACX3S course, 

Mis/;onc(^pt ions h<ive arisen concerning the ini- 
plem(|/ntati{)n awards for teacher training made 
by MSP b(!cause KDC, in its literature on the 
MACCS mat(M'ial, has referr(?d to funding by the 
Poumiati{jn of univ(!rsity/(:olleg(i/schocd district 
regi'onal centers. At the present time NSP does 
no( fun{l any regional centers for t|is- 
(?emination/implementation, and has asked EDC 
to,(l(!lete reference; to NSP sui)port of "regional 
c{/nt(;rs" from its publications. 
J'Vho f{)llowing is an excerpt from the publica- 
tion of the Par West Laboratory for Pducational 
R(!S(;ar(di and Dcivelopment pn^viously cited. 
/ 

MACOS 

.Sviiopsrs of (iiffusii)ii: 'Vhv. vnrWysl dil'fnsinn fltntls nn'l 
Willi littlf sin:i:rss. Ptiblisln*r,s wt'O' unwillint» h» C>kr on a 
coiit ro\ fM shil iiiuili-nu'tlui.pro^i'iiiu: worksliops ior tj'iiclurrs 
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elicited enthusiasm about thu course but resulted in pilot ef- 
forts, not adoptions. 

When CDA took on MAN. its staff had no intention of 
applying conventional sales techniques to the diffusion (jf 
such a complex, controversial program. Instead, they have 
-emphasized professional staff development in the training 
that is prerequisite to implementing; the course. Toiicbers 
learn not just content and teaching methods, but also 
curriculum development, evaluation, and disseminati(m. 
They become colleayut?s of the developers and of the "Inter- 
national Far.ulty.*' the «roup of imiversity pr(.fessi.rs. 
museum aiilhmpoU)gists, curriculum specialists, and others, 
who conduct the workshops and eiiHa^e in their own dis- 
semination efforts Uyv MAN, The prestige of this ^rniip is 
thought to be an important element in the curriculum's recent 
diffusion success, 

CDA ccmcent rates much of its effort on key decisionmakers 
in schools, Kv.iluations of the early dissemination showed 
that it wasscho<)l administrators with a role in staif il;;velop- 
me. t who were able to brin« about use of MAN once they 
were convinced of its worth, and so CUA now holds 
•awareness-toward-decisionmakinj^' workshops for these ad- 
minisJraturs (f<)llowed up by similar workshops for 
teachers). Another set of workshops is the 'three-day in- 
stitute,s' desij^ned to equip teacher educat ors to respond to the 
training needs of purchasers of the course while also dis- 
seminatinK informatiim about it. Workshops are also hehl in 
conjunction with the national conferences of varif)us 
educati(mal associations. The focus in all cases is on people 
who are in a pcisition to take action for the proi^ram's im- 
plementati(m. 

The publisher's dissemination activities are. evaluated 
cooperatively by the publisher iind the developer, VA)C, and 
. the resoltinl« data shayfe sub.secpient activities. Several 
barriers to adoi>li<)n have been ident ifi<!d in this way. and ikjw 
tactics have been devised to ^)V^•rco^le t he barriers. Kor exam- 
ple the materials' hij-b cost was alleviated by means ol a 
lease/purchase4)plit)n thut allows purcha,se with three annual 
payments. Problems of MAN's discontinuity with other 
curricula are. beiuH n^et liy working with all the teachers in a 
school anil l(Hikin« at the tot.il cun iciuhun rather than ^rade- 
by-^rade a(h)pti<>o. 



Problerhs suggested by 
Detailed Review 

Although Ihtj review of NSF procedures rehiled 
lo MACOSdid not identify any mujor procedurril 
. p.mbleins. t.h n rev i e vy. d i d ra i s e s om e cj ii es t i o n 
concerning the effectiveness of current practices. 
Dealing with the pi'dbleins noted l)elnvv might re- 
quire changes in NS,F policies, or modifications of 
peer review and other procedures. Any signifi- 
cant changes would probably require additional 
staff resources and funds in order to provide in- 
tensified monitoring and rtjvievv. 



Needs Assessment . 

Options include imposing a requirement that^ 
each curriculum development proposal conUiin a.- 
statement, assessing. the need for the project, es- 
timating the potential marginal contributious ixf 
the proposed work and estimating the total cost 
and time required to complete the project. 

The Foundation might consider initiating its 
own curriculum needs assessment process after 
which projects to he assigned high prriurity could 
be identified. 



Project Monitoring 

A comparatively weak aspect in management 
of the MACOS project appears to have been its 
monitoring. Site visits by NSF staff were few,, 
and no detailed review was made by NSF stall of 
contractual arrangements between the principal 
investigator and the publisher. 

UncUvr NSF's present approach to managing 
course content development projects, the grantee 
has virtually free rein in management and 
devejx^ment of the curriculum including itscon- 
-TenT. The Foundation might wish to consider re- 
quiring closer staff monitoring of projects and 
more strenuous evaluation of the products deriv- 
ed from the projects. 

Also suggested is a lack of top-level oversight 
by the grantee such as advisory committees or 
other mechanisms. Consideration might be given 
to niquirin^ that an active oversight body be ap- 
pointed by each grantee, consistent with existing 
legislation. Also. NSF might wish to consider 
current requirements for systems of record 
maintenance by the grantee on the results of 
evaluations of specific prtyjecls and of the con-, 
tributions of principal investigators. Ap- 
propriate experts within the Foundation could 
then study the nature or uniqueness of such 
relationships and mechanisms, such as in the 
MACOS project, leading to the est^tblishment of 
an NSF policy on such relationships and 

mechanisms, 

Also suggested f()r NSF corisiderat ion vvould 

be development of procedures that must be taken 
on NSF approval of all subcontracts, by the 
grantee and NSF staff to intdude a record system 
on sul)contractor negotiations and information 
on cotnpelitive negotiations between lhegranlt?e 
and sul)C(nilra(:lors. 
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Peer Review Procedures 

Tl^ese procedures might be modified to provide 
guidelines tailored to specific proposals. Con- 
sideration might also be given to broadening the 
present peer review system to include represen- 
tatives of other groups such as feachers. parents 
and community leaders. 



Other : 

In som(; instances the grantee has published 
misleading information con(;t^rning Foundation 
.support. NSr might consider requiring joint 
NSF-grantee review of all press releases or 
publicity about the work supported. 



INDIVIDUALIZED SCIENCE INSTRUCTIONAL SYSTEM (ISIS) 



Individualized Science Instructional System (ISIS); Florida ShU(? li/iive^sily, Tdliuhrisset;; S3. 353. 105; 
1972-1977 (funded) 1980 (proposed): Gratles 10-12 



The ISIS project is focused on developinj^ a 
flexible, . o p e n - e n d d , i n t e r d i s ci p 1 i n a r y 
curriculum that will facilitate individualization 
of science instruction at the hij^h school level.. 

The commercial version of the program will be 
published by Ginn & Co. as a sel of approximate- 
ly 80 niinicourses (segmer.s) which can be sold 
individually. Ginn retains exclu.sive rights to 
publish the ISIS materials until December 31, 
1984, after which exclusive publication rights ex- 
pire. 



Trial Centers 



I)t'tn)it. Mii.hij^jin 
I iillxTt. Wisconsin 
MtMiiphis. TdnnHSsiM; 
Cioiuviiy. Ark.insijs 
StilUviitiM'. (Jkliihoiiiji 
.Miinlifittad. Kansas 
MiniiiNipi)lis, Midnrsotii 
Sii(;r;iiniMili), C^alilornia 
San [nsi?, (California 

The supported centers receive ISIS materials 
at no cost, while the independent centers pay 
only the cost for production of the materials they 
use. Neither Ginn & Co. nor Florida Stale LJniver- 
sily realizes a profit on these materials. 



The ISIS project has eij^ht supported trial 
centers and fourteen independent trial cent(irs 
which participate in the field tesls of ISIS 
materials. These centers are located in the 
following cities: 

Supported Trial Centers 

Atlanta. CI(M)r«ia 
TallahassL'fi, Florida 
Haupp)au^c. Now York 
New town Sf^uari?, Pmmsylvania 
E:]vanslon. Illinois 
Dallas. Tnxas 
Sani^DiejJo. C^ilifornia 
Conr:orci. Califr>rniii 



Independent-Trail Centers 

Farminyton. Maim* 
Lexington. Massachnsntts 
Albany, Nnw York 
Upper Marll»or(». Viarylanil 
Uadi? (atv. Florida 
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Current Status 

Twenty-four ISIS niinicourses were field 
tested throughout the country du"'ng the 1974-75 
school year, and some will be added for 1975-76. 
Most of the more than 200 teachers using 'SIS 
trial materials have selected about 12 of these 
niinicourses for use in their classrooms. 
However, several ISIS trial teachers are involved 
in exploring different ways of managing a year- 
long science instructional program compri,sing 
all of the minicourses. 

Over 7,000 students and nearly 90 teachers in 
48 high schools across the country are par- 
ticipating in the evaluation of ISI.S materials in 
the supported trial centers. In the incleper^dent 
centers more than 3,500 students and more than 
120 teachers in 60 high schools are using ISIS 
trail materials and are testing the ISIS 
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minicourses in real-world classroom settings. 
Although they are not involved in a systematic 
evaluation of each minicourse, the independent 
centers are providing valuable feedback to the 
ISIS staff because they give a sneak preview of 
what can happen when ISIS materials are used 
by students and teachers in schools that are less 
lightly linked to the ISIS project. 



Funding History 



Award Expiralion Award 

dranl Dale Dah; Amounl 

GW-7B45*. . B/3U/74 $Z9U,U(U) 
Amendments: 

1 3/5/73 ()/3o^74 nn.ooa 

2 (5/H 73 (v30.74 (>0.tm() 

3 H 17/73 H/3()/74 772.700 

4 (No uosi extension uf nxpiralion 

dale to 9/30/74) 905 

5 n/::H'74 9 ^0 70 l.(>94.905 

6 » 12'5/74 3 31/77 4HO.r)00 

Tola! .. 53.353,105 



• Ni!w* PKS 7;:-0tilUHi 

Description and Objectives 
of the Project 

ISIS will consist of approximately 80 short, es- 
sentially independent ni{)dules or mmicn^^^^ 
each requiring 2-3 weeks of classroom time. Each 
module will deal with a specific topic by presen- 
ting, in an interdisciplinary manner, the ap- 
propriate concepts from biology, chemistry, and 
physics. Pertinent information from the social 
sciences is incorporated in unit« that deal with 
the social implications of science and technology. 
Mathematics is included when necessary. For 
each module, "excursions" are developed which 
permit the student to probe into some of the more 
complex aspects of the topic. In an effort to keep 
down the equipment costs for schools adopting 
ISIS, the laboratory work makes use of materials 
and apparatus normally available in high school 
" science labs. Guidance in implementing ISIS un- 
der a variety of situations is provided by an in- 
structional management scheme. 
Short- and long-range goals of thu^ project are: 

• Elimination of the unnatural harriers 
between scientific disciplines in an effort to 



provide the student with a better un- 
derstanding of science. 

• Development of materials".- which will (a) 
motivate, students and provide them with 
sufficient knowledge to be scientifically 
literate and (b) permit more capable 
students to select and attain more advanced 
instructional goals. 

• Eprmulation of a model which, hopefully, 
will promote changes in other subject- 
matter disciplines and, eventually, in the 
structure of the secondary school system. 



Narrative History of 
Project Development 

Under a grant dated I.une23, 1971, NSF provid- 
ed support for a conference held at Callaway Gar- 
dens, Georgia in October 1971 which brought 
together 34 experts to explore the feasibility of a 
new approach to high school science This con- 
feirence was proposed by Dr. Ernest Burkman of 
Florida State University and was supported un- 
der NSF Grant GW-6799 at a level ^f $10,600. 

The persons attending the conference 
represented a broad range of experience in 
st'.ience and school instructional materials 
deveh)pment. There were one or more university 
chemists, physicists, biologists, physicians, and 
econlmiisjs. There were seve ral peo ple who held 
placed roles in The development of PSSG physics, 
the CHEM Study, BSCS biology, ECCP engineer- 
ing, ISCS junior high science-and AAAS and QS 
elementary school science. Every branch of the 
tea{:hing profession was represented including 
classroom teachers, science supervisors, school 
administrators, professors of science ducation 
and learning theorists. There was alsci* represen- 
tation from vjirious professional-organizations 
su{:h as National Science Teachers Association, 
Social Science Education Consortium, Council on 
Physics Education, the Americanlnstitute for the 
Biological Sciences, and the AAAS Commission 
on Science Education. 

The (:onferen{:e participants cited what they 
felt was considerable evidence for the inability of 
the \hv.n current science programs to mv.vA the 
needs of today's society, today's schools, and 
today's students. They felt that: 

• Many high school students were complain- 
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iny vigorously ahoul irrohivanl conlmit. 
aulhorilnrian leaching imahoils, and overly 
centra lizoci decisionmaking, 

• Many parents, and governinenl officials 
•were alarmed over the high, cost of the 

educational system. ^ 

• Many young people wv.vv. becoming more 
and more negative in their attitudes toward 
science which s(M*iously suggested I hat 
scieni:e teaching was failing to com- 
municate with students. 

• Most current curricula at that tinu? teniled 
to emphasi/.e pure science^ at [hv. expense of 
applied si:ieni:(? and that this emphasis on 

.the cU}veh)pment of al)s^ract coni:e[)ts had 
proven too difficult for many stuilents and 
had biMronie increasingly difficult todefenil. 

The conference participants concluded that the 
progress of the past deiiade hacl [)repared the way 
to lake a new step and that a new step \. .is indecid 
needed. They recommended the developuKuit of 
alternative curriculum materials that 

• P\)cus upon individuali/.ed instruction. 

• Strike a happy balance between theoretical 
and applied-ST:Tont:t?7-^ — 

• Place a considerable tmiphasis u[)on social 
implicat ions. 

In january 1972 the final re[)ort of the Callaway 
Gardens Ccmference w^as sent to NSF. In March 
1972, a proposal from Florida State University 
was submitted to NSF requesting sap[)ort of an 
effort to implement the conference recommen- 
dations. The proposed project titled the "In- 
dividualized Science lnstrui:lional System Pro- 
.ject" (ISIS), was initially funded by NSF in 
September 1972. 

In a number of ways the ISIS effort is an out- 
growth of the NSF supported Intermediate 
Science Curriculum Study (ISCS). an in- 
dividualized coordinated science sequence for 
grades 7-9. NSF project support for ISCS 

friculum development activities at Florida 
te University terminated in 1973. The project 
ector for ISIS, Dr. Ernest Burkman. was also 
original project director for ISCS, and several 
former ISCS staff members are now members of 
the ISIS staff. ISIS may be viewed as an effort to 
provide both a second generation model for in- 
dividualization and an ap[)ropriale set of instruc- 
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tional nmterials for junioi' high school studcuils 
who have btuin (i\[iosi!d to ISCS as w(dl as those 
who bav(i not. 

Description of the 
Minicourses 

According to the project director, the ISIS 
minicourses will not simply be a set of [)lans, but 
rather will be i:ompUjti! learning packag(?s con- 
ttdning evcirylhing the leai:her needs to provide 
students with intlividualized science instruction. 
Kach ISIS minicourse will have the following 
componiMits: 

1, A description of what the stuilenl is ex- 
[)e(:ted to know or i)e able to ilo in order to 
start the minicourse 

2, A .student-binguage descri[)lion of what. the 
minicourse is designed to teach 

3, Fairly fUixible sugg(!slions on bow the stu- 
dent can use the .minicourse matcirials to 
achieve these goals 

4, Instructions for carrying out each hiarning 
activity 

f). All neccjssary text materials, most likely in 
pamphlet form 

0. Any loops, slides or oth(M' audiovisual 
materials required ' 

7. Highly specific self-tests so the student can 
' di!termine when he has ai:hievi;d the desired 

learning objectives 

8. Suggested answers to the self-t(?sts and 
suggestions as to how the student can cor- 
rect his/her deficiencies 

9. Any necessary equipment that cannot be 
assum^'d to be in the classroom 

10. Materials to hel{) the teacher imi)lemenl the 
minii:ourse 

The ISIS developers feel that such a complete 
package will free the teacher from imAih of the 
routine of a classroom, and allow the n'ecessary 
lime for interaction with individuals'^)r small 
groups, 

To indicate the scope of to[)ics. brief descrip- 
tions of planned minicourses. most currently in 
trial, ar(i given below: 



Buying and Selling: The psychology of selling, 
subliminal advertising, packaging, non- 
verbal signals, association psychology. 

People Pressure (not yet in trial): Population ex- 
plosion, cyclic and non-cyclic resources, 
birth -control, sociological and psychological 
effects of crourded living. 

Seeing Colors; How we see coh)r. color subtrac- 
tion in mixing paints and filters, color addi- 
tion in printing.and color TV, color fatigue, 
day and night vision, colors of signs and 
emergency vehicles. 

Ways We Learn; Some experiments in the lear- 
ning of humans and other animals, fa{:t{)rs 
which favor learning and forgetting. 

Heart Allack;The circulatory system, its normal 
functioning and malfunctioning. 

Plants Indoors: drowing healthy plants untier 
unfavorable conditions, leading to the re- 
quirements and mechanisms of plant nutri- 
tion and growth. 

Fire and Explosion: Explosions involving rapid 
oxidation, relationship of contientratitjn of 
reaclanls and particle^ size, dangerous 
household situations. 

Home Electrical Appliances: Fault diagnosis and 
repair, what is safe to do and what is not, cir- 
cuits of simple household appliances, effects 
and treatment of electrical shock. 

Household Energy: The optitjns available at the 
community and individual level in the selec- 
* tion of sources of power, the analysis of cost, 
and the feasibility and convenience of each. 

Two other proposed minicourses are described 
in a more expanded form to illustrate the variety 
of approach possible in a minicourse structure 
and possible relationships between core and ex- 
cursion activities. 

^^dunds of Music: The starting point of this 
i minicourse is a cassette tape of a practice 
' i session by a high school dance combo. 
Members of the group discuss on the tape th(; 
characteristics of the notes of th(;ir various 
instruments. Students follow this discussion 
through a printed booklet in which the wave 
forms of notes which differ in pitch loudness 
or harmonics are shown. This introduction 
leads U) laboratory exercises using musical 



instruments in which the ideas introduced in 
the tape are developed and consolidated. The 
excursions enable students to consider a 
range of related topics such as the 
physiology of musical perception or the 
quantitative relationships between pilch, 
tension and length of stretched strings. 

Packaging Passengers: This topic is focused on 
the packaging of humans to lessen injury in 
auto crashes. The students use experiments, 
filmed sequences of simulated crashes and 
data to develop the relationship between in- 
jury and deceleration time and to study the 
effe.ctiveaess oi seat belts, air bags and other 
' design features in reducing injury. The ex- 
{:ursions enable students to pursue the topic 
further by undertaking aconsumersurvey of 
seat belts, debating whether the wearing of 
seat belts should be compulsory, packaging, 
an egg to withstand dropping, considering 
the natural patikaging of the eye, fetus and 
brain, or cah:ulating pressure of impact and 
other quantitative aspects of collisions. , 



Analysis of Impact 

ISlS trial materials are currently being used by 
more -than 10.000 high school students attending 
the ISIS trial center schools located throughout 
the U.S. It isstill tooearly to assess the actual im- 
pact of the ISIS program since no final versions of 
minicourses have been developed. 

According to the ISIS developers there is 
already a high demand for ISIS paterials. and 
they plan to release minicourses as soon as they 
are completed. 

Twenty-nine trial minicourses have been made 
available for the 1975-76 school year, and plans 
are tt) release an additional twenty minicourses 
during each of the following three years. 

Two of the trial minicourses prcjduced by ISIS 
art; {:{)nsidered sex education by some— 
lUiprodiiidian and Birth and Growth. Recogniz- 
ing this fact, the ISIS staff S(;nt letters to all prin- 
cipals whose schools were using ISIS materials 
informing them of the possible sensitive nature of 
these two minicourses. One trial center (Dallas, 
Texas) decided not to use lh(; two minicourses. 
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Review and Oversight 
History 



Both the Callaway Gardens conference 
proposal and the subsequent ISIS proposals were 
unsolicited and were submitted to the NSF Pre- 
College Education in Science (PES) program. 
Program announcements concerning PES ac- 
tivities are widely disseminated, and state that 
they are designed to generate a variety of 
proposals for innovations in pre-coUege science 
education. 

Criteria established for ISIS reviewers re- 
quired that they 1) represent a cross-section of 
disciplines; 2) be prominent in their areas of 
speciality; and 3) be interested in and experienc- 
ed with pre-coUege education. It appears that all 
ISIS proposal reviewers met these criteria. 

Reviewers were directed to make an evaluation 
of the proposal based on the merit of the idea, the 
feasibility and effectiveness of the procedure, the ' 
qualifications of the persons who would carry \ 
out the project, and the reasonableness of the 
budget. 

During the initial development {)f ISIS, two 
committees appointed by project staff provided 
oversight to the project's activities, the Planning 
Committee and the Advisory Coriimittee, The 
Planning Committee s task involuted the actual 
production of guidelines and samples ol^topics, 
whereas the Advisory Committee's function was 
to review such materials and give advice on 
general policy. 

^ Early on, however, it became apparent that the 
two committees did not provide the desired flex- 
ibility for carrying out the ISIS project activities, 
A single lesS-structured Advisory Board was 
formed to replace the two committees. Many who 
were on the original committees were placed on 
the new Board, but there were a few additions 
'and deletions to obtain the disciplinary balance 
needed. A number of teachers and science super- 
visors were added, for example, to get an input 
from those closest to the classroom situation, 

ISIS has divided th^ members of the Advisory 
Board into short-term task forces containing the 
combination of talents required to deal with par- 
ticular problems that arise. Thus, there are few 
meetings of the entire Board. Instead, relatively 
small groups of advisors, clustered on the basis 
of their competencies concentrate, as needed, on 
problems in their area of expertise. Some 
groupings are multidisciplinary, while others are 
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more discipline centered. | 
The members of the ISIS Advisory Board are: 

ISIS ADVISORY BOARD 

|()hn Bare 
Psychologist 

Carlelon College, Minnesota 

William Bass 
Anthropologist 
Univ. of Tennessee 

(Gregory Choppin 

Chairman, Dept. of Chemistry 

Florida State University 

William Cook 

Dean, College of Natural Sciences 
Colorado State University 

John Davis \ 
Superintendent of Schools 
Minneapolis F^iblic Schools 

Karnestine Forte 
Biology Teacher 

Miami. Floriila Senior High School 
Robert Gagne 

Psychologist and Professor of Instructional 

Design and Development 
Florida State University 

Dairell Goar 

Science Coordinator 

Moline, Illinois Secondary Schools 

Franz Halherg 

Professor of Health Sciences 
Chronobiology Labs, Medical School, 
Minneapolis 

Wayne Hollzm'an 
Kdiicational Psychologist 
University of Texas 

Allene lohnson -^^ 

Chemistry Teacher 

Summit N.|- Senior High School 

Leon jnrdan 

Biology Teacher 

Trevor G. Brown High School 

Phoenix. Arizona 

Fdward Korm(>ndy 

Biologist. Vice President, and Provost 
Division of Natural Sciences 
Kvergreen State College, Washington 

Alfred Kuhn 
Ki:onr)n)i.st 

University of (Cincinnati 
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ERIC 



Robert Lehrman 
Chairman, Science Department 
Roslyn High School 
Roslyn Heights, N,Y, 

Dorothy Magett 

Director of Human Resources , 
Evariston. III. Township School 

. W: T. Martin 
Mathematici.Mn and Dinrctor 
Division for Study and ResiNiri:h in Kiiucalinn 
Mhss, Institute of 'I'echnolngy 

Howard Mehiingur 
Political Scientist and Director of 

Social Studies Development Oenter 
Indiana University 

Irving Morrison 
Executive Director 

SocialrScience Kdiii;ati()n ('onsort iiim 
Boulder Colorado 

Rod O'Connor 

Chemist | 
Texas A&M University 

Benjamin Peery, |r. 
Astronomer 

Indiana University » 

Reuhin Pi(?rj;e 
Principal 

Ballou Sentor Hi^h S'-hool 
Washington, D,C. 

Samuel Postlethvvait 
Biologist 

Purdue University \ 

Douglas Reynolds ^ 
NY State Sr.it;n«:e .Supervisor 
Albany, N.Y, 

Charles Kussell 
Assistant Principal \ 
Northern High Si. hoot 
Detroit. Michigan 

Milton Saj:law 
Director, Dade County 
Florida Department of Puhlii; Heidlh 

Ray mo ml Staley " 
Oceanographer 
Florida State University 

Dallas Stewart 

(•eorgia State Scieni;e Supervisor 
Atlanta, ('.eorgia 
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William Story 

Texas State Science Supervisor 
Austin, Texas 

Donald Thoinsen, |r. 
Presiilent 

SIAM Institute for Mathematics 

and Society 
New Caanan, C)T 

•john Tfuxal' 
Dean 

Oollcge of Kngineering 

State Univ, of New York aJ^^Sttiny Urook 

Kli/aheth Wood 
Physicist 

Bell I.al)orat(n-ics (rctireil) 

Chen Niug Yang 

Physit:ist' ' 

The Institute for Theoretical Physics 

State*University of New York at Stony Urook 

Herbert Zini 

Science ctmsidtant. editor, and writer 
TavfM'nitrr. Kla. 

Source: ISIS Newsletter No. 3. Florida State University. 
T.illahassee, Fla.. Het:. 1974, 



Proposal Review 

■| 

All reviewers fci^reed that the d(3velopm(ml oT 
the prnjncl was opport une, especially in view of 
th(i propostid flexibility of the curriculum and its 
modular slrutituije. and all recommended funding 
but none without raising questions, as is usual in 
tho review process, on aspects of the proposal 
plan. 

Reservations focused on five main areas of con- 
cern: (1) Some reviewers felt that scientific con- 
cepts very often build on each other and were ap- 
prehensive - that the nature of the proposed 
curriculum would prohibit such growth, (2) 
T'here wertj questions rtigarding the management 
system for schools and teachers which the 
proposal promised to provide. It was felt that the 
system was neither sufficiently explained nor 
was the manag(Mnent plan begun early enf)Ugh in 
[hi\ (lurriculum dtjvelopment stage. (3) Some 
Hjviewers ft^lt that there was inadequate provi- 
'sion for laboratory and probltMn-solving 
situations within the learning scheme, (4) The 
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evaluation procedurns were attacked for being 
insufficient and too informal. (5) There was some . 
speculation that the methotl of ' c^evelopnujnt 
might prove inefficient. 

Sections of reviewers' comments were s(;nt to 
Dr. Burkman at Florida State for his cqtnment 
prior to a final decision on the disposition of the . 
proposal. Dr. Burkman replied in tletail to the 
critical points that were raisetl. In atldition, PKS 
staff met with ISIS project staff to clarify matters 
further. These 'elements , of the decision pro(:ess 
are documentetl in an internal program 
memorandum of Sept. 5, 1972. 

The, PES staff indicatetl that they were 
satisfied with, the project staff's reactions to 
revie\)!^ers' concerns antl strongly reconimentletl 
ar| award of 8550,000 for start-up and initial 
development of the project. The PPiS staff also 
rocdmniendetl that this award be foUpyved by an 
award for the balance of the budgetetl S 1, 127.700 
at ap appropriate date if the initial phase provetl 
satisfactory. ^ 

Ifi the written iiiiiterial presented to the 
National Science Board, reviewers' remarks con- 
cerning the original proposal coultl a[)pear to be 
talcen out of context and appear to be a mis- 
representation of what the reviewers actually 
said. This is because the NSB WTiteup tloes not 
describe the negative comments. Dr. Burkman's 
detailed rebutlaK and the meeting between ISIS 
and NSF staff which dealt adequately, in the 
staffs view, with reviewer criticisms. A list of 
specific accomplishments of the project to tlate 
was included in the staff recommendations t,o the 
National Science Board. They includetl: 

a> Development of a specific statement of 
goals desirable for a high school science 
program. 

b. Formulation of an. overall matrix of 
miriicourse topics. 

c. Selection of a publisher. 

d. Field evaluation of ten minicourses having 
titled such as: Household Chemistry, Heart 
Attack, Packaging Passengers, and Buying 
and Selling. 

e. Development of a preliminary framework 
for the instructional manageiipent scheme> 

The second ISIS proposal for support of the 
project during the period July 1974— September 
1976, received an in-houst; staff review. Con- 



tinuation of the initial effort at a level of 
§2,175.400 was approved by NSF staff and the 
National Science; Board. NSF staff felt that it was 
not necessary to have the proposal reviewed on 
the outside, since the initial proposal had incUid- 
ed plans for the continuation and had been, 
evaluated on this basis. 



Evaluation of Materials 
and Proces%es 

In this curriculum development i)roject it is im- 
j)ortant to tlifferentiatc betwecin formative and 
summativcj curriculum evaluation. Formative 
evaluation involves the collection of information 
which can be used to improve instiuictional 
mattirials in terms of t heir impact upon children, 
Summative evaluation seeks to deternyne what 
, happcms \o children as a result of exposure to a 
fully developed protluct'. A discussion olf the sum- 
mative evaluation of the proposed pr(|Kluct was 
i|ot made in the original proposal bt^cause the 
principal investigator felt that such, an effort 
could not be carried out for at least seven years. 

'rhe proposal recommends criterion-referenced 
testing rather than normative testing. The object 
i_s to find out how many children meet specific 
::riteria ratherlhan how many achieve an average 
score (jn a test. Because criterion-referenced 
testing is done item by item rather than by test, 
existing normative-based standardized tests are 
not considered appropriate for the purposes of 
Che ISIS project. 

The evaluation pbm is described as follows: 

1. Goals for secondary science teaching will be 
established and the selection of module 
topics will be on the basis of these goals. / 

2. Ea{:h m^lule will include a specific descrip- 
\ tion of wt^at the student is expected.to know 
\ or be able to do after completion oT-the 

, module. 

When each module is field tested, a goal will 
be to ascertain how many students perform 
as expected after completing the module. 
Revisions will be aimOd at increasing the 
number. 

4. The project staff expects to be unable to es- 
tablish objective means to measure the 
(hjsirable outcomes of some modules. In 



108 

106 



these cases they will use the subjective 
judgment of teachers, of students, and of the 
-^r staff to determine ^whether the objective is 
being accomplished. 

5. In addition to evaluating student success in 
meeting the criteria of each module, the pro- 
ject staff will ask teacher and studej?it opi- 
nion on how a given module might be im- 
proved. ThroTigh this kind of subjective in- 
formation, the staff hopes to detect evidence 
of 1 such correctable problems as poor com- 
munication, unrealistic time estimates and 
invalid judgments about the level of 
knowledge and skill possessed by most 
students. 

Additional information to clarify how the 
above steps will be accomplished, include the 
following: 

1. Goals will be established through a 
modified Delphi technique thus insurmg 
adequate input from many relevant por- 
tions of society. 

2. Module objectives will be prepared as the ' 
modules are developed. An Civaluation 
specialist will have principal responsibility 
for preparing objective statements. Validity 
of the obje(;tives will be insured by haviiiH 
the statements verified by module authors. 

3. Items for measuring; objectives will be con- 
structed by an evaluation specialist. Each 
item will he validated by the appropriate 
module author and will be edited for 
languaj^e by a communicator. 

'4. Base-line data on tryout student aptitude 
will be obtained from tryout school records. 
Availability of appropriate aptitude test in- 
• formation will be one (:riteri(in for sehictin^ 
tryout schocls. 

5. The objective based IttMiis for each module 
will be administered individually rather 
than as a "test''. Interpretntion of testing 
results for a givnn module will be in t(?rms of 
the number of students who successfully 
respond to each. item. Where entering levtd 
of performance is needed, individual item 
pretests will be ^iven. 

0. Teacher and student opinions will be 
collected by questi(mnair(: or direct inter- 
view. Which response? method is chosen will' 
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depend upon the proximity of a tryout 
school to an appropriate project represen- 
tative. 



Monitoring History 

The NSF has monitored the progress of the ISIS 
project through site visits, telephone convei-- 
sations, and correspondence through the mails. 

In December, 1974, NSF appointed a team of 
three outside reviewers to conduct a substantive 
evaluation of the ISIS project. The results of 
these reviewers' findings will be used by NSF 
staff in its overall evaluation of the progress of 
the pftoject. ' 

NSr staff members have attended some 
meetings of the ISIS Advisory Board and have 
monitored very closely all of the ■ reconimen- 
datinns and actions flowing from this advis(iry 
^roup. ' ' 



Dissemination/Implementation 
Plan 

Current plans call for completed minicourses 
^ to be released in groups of 15 to 20 through (he 
commercial publisher (Ginn and Co.) over the 
m;xt five years. The. first lot of 10 minicourses is 
scheduhul for commercial release in 1975. Each 
will be usable individually or will collectively 
form a niultidisciplinary science course for 
average and below average students. 

With the release of each succeeding lot of 
minicourses, the number of possibilities for 
(dustering.theni into courses of various sorts will 
incr(!ase. Ultimately it is expecteti that schools 
Will be able to build several varieties of biology, 
chemistry and physics courses, and that there 
will 1)(!, innumerable niultidisciplinary course 
possibilities as well. By 1979 the ISIS project ex- 
pects to haye published enough minicourses to 
allow scb^ls who wish to do so, to totally 
replace their high schocd science programs with 
one,' of many locally d(;terjnine(l alternatives. 
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ProiectetHSlS Timetable 

September 1976 

Twenty minicourses commercially available 
enabling schools to offer: 

1- year multidisciplinary science programs 
with a good degree of flexibility. 

September 1977 ^ 

Forty minicourses commercially available 
enabling schools to offer: 

2- year multidisciplinary programs 
1-year biological science programs 

September 1978^ 

Sixty minicourses commercially available 
enabling schools to offer: 

3- year multidisciplinary programs 
1-year biological science pgorams 
1-year physical science programs 
1-year physics programs 

1-year chemistry programs 

September 1980 

Eighty. minicourses commercially available. 
Complete management scheme available. 

ISIS publishes a free newsletter to keep in- 
terested people informed of the project's 
progress. Also available (for purchase) is a sam- 
ple set of three of the minicourses now being 
tested. 

Problems Suggested by Detailed Review 

1. What kinds of needs assessments should NSF 
require before embarking on long-term sup- 
port for national curriculum development and 
implementation projects? Can the results of a 
single conference in certain instances serve as 
a needs Vsse.ssment? (ISIS resulted from a 
single^onference.) 

2. What role should NSF play when supporting 
. feasibility conferences to guarantee that con- 
' ference participants are really representative 

of a broad spectrum of ideas for improving the 
school science curriculums? 

' 3. What should NSF policy be concerning dis- 
semination of conference reports, especially in 



those cases where conference results are used 
as a main justification for NSF support of a 
national curriculum project? (The Callaway 
Gardens report. had limited circulation.) 

4. What materials, other than the proposal itself, 
should be provided to NSF reviewers? 

5. Because of the highly interdisciplinary nature 
of the ISIS proposal and the implications it 
held for change in the high school science 
curriculum on a national scale, a mail review 
of. the proposal would seem to be quite inade- / 
quate. What should the Foundation's policy be/ 
on proposal review systems for curriculum 
development proposals? / 

6. In what form and under what circumstances 
should reviewers' comments be transmitted to 
the proposer? (Direct quotes of ISIS reviews 
were provided to proposer.) 

7. What should the format be for grant 
recommendations by a program manager? 
(Negative reviewer comments were not dis- 
cussed in as much detail as positive aspects) 

8. What should the format be for making grant 
recommendations to the National Science 
Board? Whatshould be included? What may be 
excluded? (ISIS materials provided to the NSB 
did not describe the details whereby the 
proposers responded tonegative aspects of the 
reviews) 

9. ; Three minicourses planjied for ISIS could be 
1 considered by some to be sex education: 

Htiproduction, Birth and Growth, and Human 
Sexuality. 

Human Sexuality is in a very primitive stage of 
development and is not yet available for use in 
the ISIS trial schools. The other two minicourses 
are in a trial stage and are currently available for 
use by the trial schools. The procedures for the 
development and use of these materials should be 
carefully monitored by NSF. The materials, in 
their present form, could generate controversy 
even though there is an explicit disclaimer of NSF 
approval or disapproval included in the 
minicourse booklets. There is clear need for NSF 
policy and procedures to ensure that areas where 
controversy might be expected are dealt with ob- 
jectively and openly and that topics of possible 
concern in various localities are made evident 
vvithtiut (lama<^in^ the scientific integrity of the 
course material. 
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Appendix 5 



Summary Audit Report 
on Selected Curriculum 
Development Projects 



111 



109 



In compliance with Ihn rtuiuesl of the C^hnirman 
of the review team ior .pre-coUn^e science 
curriculum development activities, the NSF 
Audit Office prepared nn audit of the financial 
transactions of the five ciirriculuni development 
projects selected for case study. 

The purpose of this audit was to review, to the 
extent possible under the circumstances, the 
financial records at NSF and j^ranlee locations to 
determine (1) the propriety of direct and indirect 
expenditures charged to NSF grants, (2) whelhtM 
the fiscal reports submitted to the NSI' were 
reliable and in agreement with the grantetis' 
records, (3) the adequacy of the grantees' ad- 
ministrative and accounting procedures, (4) 
whether grant income was handled in accordance 
with NSF policy, and (5) whether NSF policies 
and procedures were followed in administering 
the grant. 

This audit included a review of grant records 
maintained at the NSF and at three grantee 
locations and a review of prior audits performed 
by this audit office and by other Government 
aurMt agencies. (Conclusions from this review of 
the financial transactions of the five select(id 



curriculum development projiicls an? pres(Mitt»d 
by program. 

Chemical Education Materials 
Study (CHEM Study) 

CHHM Study was initiated i)y Grant G-7H5() 
awarded to the C3hio State University on 
F(;bruary Z7, '19v59, in the amount of $11,500 for 
the purpose of supporting an '^Interim Planning 
CC()mmitt(»e for Chemistry Course Content 
Studi(?s of High School and General College 
Chemistry." This grant was completed in August 
1959; however, the final fiscal report shows ex- 
penditures incurred through lune 30, 1960, Since 
that lime, CMEM Study has been supported by 
the National Science Foundation by grants G- 
11090 and G-1222(5, awarded to the University of 
California, Berkeley Campus (UCBC). These 
grants continued support for the Steering Com- 
mitltje and provided support for the origination 
of a chemical education materials s.tudy. 

A summary of the grant awards is as follows: 
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During 1966, the NSF Audit Office performed a 
financial audit of the University of California, 
Berkeley Campus, with particular emphasis on 
the CHEM Study project. The purpose of this 
audit was to determine (1) the propriety of costs 
charged to NSF grants, (2) whether the grant 
fiscal reports submitted to the Foundation were 
in agreement with the University*s accounting 
records and are reliable, (3) the adequacy of the 
University's administrative and accounting 
procedures for financial management of NSF 
projects, (4) the adherence to required 
procedures for the administration of NSF 
fellowship and trainee programs, and (5) the ade- 
quacy of the accountability for income generated 
by NSF grant activities. Accordingly, the audit 
included a review and evaluation of the Univer- 
sity's procedures and internal controls insofar as 
they pertained to NSF grant activities and a 
review of the expenditures charged to the grants 
on a test basis. 

The audit report is dated December 15, 196*6, 
and indicates that with minor exceptions, UCBC 
financial administration over NSF grants was 
performed in a satisfactory manner. Exceptions 
were subsequently resolved with ofiicials of the 
University. In view of this prior audit the present 
review was directed toward UCBC activities 
subsequent to 1966 as they affected the CHEM 
Study records maintained by FMO and GCO and 
discussion of current UCBC financial records 
with the resident Government auditor from 
DHEVV. 

As a result of the prior audit experience and 
current review, NSF is satisfied that the UCBC 
accounting records are adequate; that the expen- 
ditures reported to NSF are accurate; and that 



UCBC has complied with NSF requirements and 
that NSF grants G-7656, G-11090 and G-12226 
have been properly closed. 

NSF/FMO records indicate that from July 1, 
1965, to September 19, 1972. UCBC remitted 
grant income from sale of publications totaling 
$4,027,448 to the Foundation; $3,563,794 was 
deposited as miscellaneous receipts in the U.S. 
Treasury, and the balance of $463,654 was 
transferred to the NSF Director's Reserve. 
Questions of income procedures have been 
resolved and all income has been satisfactorily 
accounted for on NSF records. 

In conclusion, the Audit Office is of the opinion 
that the financial records maintained on the 
CHEM Study properly reflect the financial trans- 
actions between NSF and UCBC, in accordance 
with acceptable accounting practices and in com- 
pliance with NSF and other applicable Govern- 
ment regulations. 



Science Curriculum 
Improvement Study (SCIS) 

SCIS was initiated by NSF grant GE-600. 
awarded to the University of Maryland on Oc- 
tober 26, 1962, in the amount of $40,250 for the 
purpose of supporting an "Elementary School 
Science Curriculum Study." This grant was com- 
pleted in |une^1964\ SCIS has also been supported 
by NSF grant GE-2914, awarded to the Universi- 
ty of California, Berkeley Campus (UCBC). This 
grant continued to support the development of a 
science curriculum improvement study. A sum- 
mary of thegrantawarded to UCBC is as follows: 
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As previously indicated, during 1966 the NSF 
Audit Office performed a financial audit of the 
University of California, Berkeley Ciimpus. In 
view of this audit, the present review was 
directed toward UCBC activities subsequent to 
1966 as they affected the SCIS project. Accor- 
dingly, the review was limited to a review of NSF 
records maintained by FMO and GCO and dicus- 
sibn of current UCBC financial records with the 
resident Government auditor from DHEW, 

In the review of SCIS, a difference was noted 
between grant expenditures reported on the 
Quarterly Expenditure Report (QER) and those 
reported on the fiscal report amounting to 
$110,330. This difference was the result of . 
UC^C's deduction of royalty incbme from grant 
expertditures which are reported on the QER; 
since royalty income was maintained in a 
separate account (in accordance-with the terms of 
grant amendment 11), the total expenditures I 
were, reported on the fiscal report. The terms-^f 
grant'^vamendment 11 require that total income 
receipt\and disbursements of royalty income be 
reported ^lo NSF semiannually; however, these 
reports were not located in either the FMO or 
GCO files. 

It is therefore recommended that the program 
office strengthen its income procedures so the re- 
quired reports are available. Also, income report- 
ing procedures should be made clear to the 
grantee so that QER reports properly reflect total 
expenditures from obligated; NSF funds (grant 
awards) to assure that NSF/FMO report* to the 
U.S. Treasury taken from QER information are 
correct. Income funds, whether subject tti expen- 
ditures or not, should be separately maintained 
and reported. The Audit Office was advised by 
the grantee that royalty income was reported in 
technical reports to the NSF Program Manager. 
The grantee has agreed to send NSF separate in- 
come reports. (These were received on April 22, 
1975. and are adequate to comply with NSF in- 
come procedures.) 

UCBC statements on the grant revolving fund 
wera examined. These have been. subniitled on a 
tinjely basis. A sUmmary of this activity at 
, December 31, 1974, is as follows: 

Snips , S2H4.751} 

Centcr.disl)ursi;mi!nls ^ 2^^.)Syin\ 

himl Ihihincr at 11^ 3 1 74 $ 2:>.2yi:\ 



In conclusion, except for the difference in grant 
expenditures reported on the QER and on the in- 
terim fiscal report, and the absence of separate 
income reports (both of which have been cor- 
rected), the Audit OSIice is of the opinion that the 
financial records maintained on SCIS properly 
reflect the financial transactions between NSF 
and UCBC, in accordance with acce. able ac- 
counting practices and in compliance with NSF 
and other applicable Government regulations. 



Man: A Course of Study (MACOS) 

MACOS was developed by Educational Serv- 
ices Inc. (ESI) which later became Education 
Development Center.v Inc. (EDC), Newton, 
Massachusetts, under three grants awarded by 
NSF. The figures below reflect awards fc^r 
development by EDC only. In addition the Foun- 
dation made grants of $1,073,118 to the 
Washington School of Psychiatry and Antioch 
College for evaluation projects; $44,700 to EDC 
for a history review; and implementation awards 
in the amount of $2,166,500. ^'summary of the 
development grant awards is as follows: 



C;rant Period Award Expanded 

GK-lH:n 2/lH/ri:J - 6/30/{i3 S91.440 $91,429 

C;K-25{)7 0/25/(13- 8/31/64 103.980 103,748 

(;i>3430 l/Ori/03 - 9/30/72 . 4,H01,900 4.330.773 

$4,797,380 $4,525,950*. 



* DeliiiUui (;xpi;nditnr(;s on file. 

During 1969 the NSF Audit Office performed a 
management audit of EDC. The purpose of this 
audit was to determine (1) the propriety of direct 
and indirect costs charged to. NSF grants. (2) 
whether the fiscal reports submitted to the NSF 
were reliable and in agreement with EDC's ac- 
counting records (3) the adequacy of EDCs ad- 
. ministrativ.e land . acco.untjng. jDroc.ed^^^^ [4] 
whether EDCs procedures for computing in- 
direct cost$. were acceptable and in accordance 
with NSF guidelines. 

The audil report. wa,s dated May 4, 1970. it in- 
dicates lhat, with minor exceptions, EDC finan- 
cial administration of NSFgrants was performed 
in a salisfnctory manner. There was an indicalion 
that prociedures to evaluate project perlormance, 
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payroll procedures, and purchasing controls 
needed strengthening. 

In view of prior audit conclusions, thy review 
was directed towards EDC activities subsequent 
to 1969 as they affected the MACOS project. Ac- 
cordingly, the review inclijded an examination of 
NSF grant files for the three grants, a review of 
the NSF/FMO records, and a site visit to EDC for 
the purpose of reviewing its accounting records 
of MACOS since 19(>9. Also reviewed was the 
prior audit report of iV^ay 4, 1970, and audit files 
concerning MdC. \ 

Grant GE-A430hasbeenclosedforexpenditure 
purposes ancl EDC hasj submitted a final fiscal 
report; howeOer, GE~34aO has been kept open on 
NSF financial records in order to provide a means 
of controllim; the income received by EDC from 
grant actiyflies. The Audit Office is satisfied that 
EDC has/f)roperly controlled, reported ancl sub- 
mitted t/nis income to NSF in accordance with in- 
strucUf()ns given them from NSF. 

EuC has reported income to NSF in total; that 
is, me income is pooled and identification of in- 
come to specific grants is not always possible. An 
estimate based on analysis of details submitted 
w'lih the income was made; by C;CQ to determine 
the amount of income and expenditures 
' applicable Ici CJK-3430. This is sunimari/.ed as 
follows: 
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I I j iii'1-..nisi' tl.ii nrvii*' anrl Sin, in siippoi trd p.ii l nl thi' 
' (icvclnpiiH-llI nl i{H:(iin('-p|-n(liiririi» .H.livitirs. piirt ni itir Inliil 
iru:nm»' is tiilnr.itrU In i-AW., 

The Audit Offict? has reviewed thi: CCA) sum- 
mary of total income and the (let(?rniination of the 
amount applicabb? to ('dv343() and is in a^^ret?- 
mtint with this summary. Ini.onic consists of 



royalties, sales of films, film strips, course 
materials, teachers sets, etc. 

Although EDC has satisfactorily accounted for 
expenditures and income, it was noted that ac- 
tion should be taken by NSF on grant GE-3430 (1) 
to deobligate on NSF financial records $270,000 
^awarded by Amendment 8 (June 25, 1969) and not 
used, (2) to obtain' from EDC approximately 
S6,000 of grant incoirie and interest earned in 
1970 and not submitted, and (3) to correct the 
Quarterly Expenditure Report (QER) to reflect 
the proper grant expenditures as.shown on the 
grantee's final fiscal report. 

Amendment 8 awarded $270,000 to establish a 
revolving fund for the purpose of publishing 
MACOS from May 1, 1969\ to April 30, 1970, A 
summary of the account is as follows: 

" I 

\ 

Awjinltiti l)y AiiHindnnmt H \ $270,000 

Ktjcripls frimi snlcs \ 57n.:M7 

SH40,:i47 

K\pt'iuiitiin:s :^7ZM 's\ 

Miii.in.if S27n,.'')04 

I 

/ 

EDC rectiives funds under a hitter of crfnlil 
without direct relationship to a specific grant, 
'i'lie incouH! gen(!rat(;d through the activities un- 
d(M' grant amendment 8 exceeded the exptMises 
and theref{)re the $270,000 was not considered to 
be (iriiwn by HDC; in addition, EDC has not in- 
cluded it in the amount of the total grant award in 
their final fiscal report. The $270,000 remained, 
however, as an iuvard on NSF records and was 
therefore? available to HDC, 

i'he Audit Office was of the opinion lbi^^ the 
amount of $270,000 should b(; immediately 
(l(M)bligal(Ml so that it would. not be inad vcM'tctnUy 
.used by EDC, (?ither on MACOS or (through the 
■l(?tter of credit funds) on any oth(M' grant. The 
$270,000 was deobligated by tb(! Financial 
Management Officer an April 23, H)75, and it \^ 
n\) longer iiyuihjl)le_.to . EDC 

I'l'be activili(js authorized under AnuuidnKMit 8 
})ro(luced a net income as of SeptiMuber 30, 1970, 
of $f),ri()4. 'rh(!se funds have lufon carri(?(l in the 
EDC general funds-and-h^i-uitnol been indudediia- 
tin? '*[)ot)l(Ml inconnj" accounts. EDC has reported 
these funds to the NSF at rtjgular intervals, and 
th(! final report was s(miI to NSF by letttir on 
February 12, riS75. The Audit Off ic:e reiiummends 
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that NSF request that this amount be submittiul 
for return to the U.S. Treasury account of mis- 
cellaneous receipts. 

It is further noted, in connection with the net 
income of $6,504, that corporate funds on hand in 
excess of immediate working capital needs wern 
usually invested by EDC. It is recommended, 
therefore, that EDC be requested to pay interest 
on $6,504 from September 30, 1970. to the date of 
submission to NSF, at the rate effective during 
that period. 

Finally, expenditures noted in the NSF 
Quarterly Expenditure Report for GE-3430 are 
$3,975.05 in excess of the amount reported by 
EDC in their final fiscal report. It is recommended 
that NSF correct the QER to reflect the report^id^ 
.expenditures. 

In conclusion, except for those matters noted in 
conn^^ction with Amendme^^t 8 and the QER on 
GE-3430 the Audit Office is of the opinion that 
the records of NSF and EDC prop\?rly reflect the 
financial transactions of MACOS, in accordance 
with acceptable accounting practice. and in com- 
pliance with NSF and other applicable govern- 
ment regulations. 



Poiiticdi Science Course Content 
Improvement Project for Elementary 
and Secondary Schools— Comparing 
Political Experiences (CPE) 

The project has b^en supported by the National 
Science Foundation since 1972 by grant GVy- 
6810. awarded to the American Political Science 
Association (APJ^A). Washington. D.C.; Indiana 
University and Ohio State University are sub- 
contractors to the grant. With [hn exception t\^f the 
project director, estimated costs lor Ohio State 
\ University are not specifically outlined in the 
\ budgets. Funding has been provided as follows: 

\ Awiiid Amount 

\ iT^TI'-'TTn ^~r," !5 n») 

\ - :p;n'7fi :n7.9(Hj 

9.(11 74 ' \'1>:\\ 7ii VA'lAOl) 

\ S i.^rii.ooe* 



The purpose of the review was to (1 ) review the 
expen( litures niade under the grant, (2) determine 
that the expenditures reported to the NSF were in 
accortlance with the records of the Association. 
[[\] review the atlministrative procedures and ac- 
counting controls of The American Political 
St:ience Association concerning this project to 
the extent considered necessary and (4) review 
the income aspects of the grant. 

Accordingly, the administrative procedures 
and financial controls were discussed with the 
Kxecutive Director and Staff Associate of The 
American Political Science Association and the 
financial control records ol the Association were 
examined to verify the amounts reported to the 
NSF. The scope of the examination also included 
a review of APSA budgeting procedures, 
publishing agreements and royalty and income 
policies. DHEW Audit Agency is the cognizant 
audit agency for Indiana University and Ohio 
State University participants under this grant. 
DHKW has most recently reviewed Indiana Un- 
iversity's accounting records and submitted a 
report dated March 8. 1972. which indicated that 
the University s accounting system was general- 
ly acceptable. This report is on file. 

As a result of the review of the financial 
records of APSA, and based upon the DHFAV 
audit cognizance at Indiana University and Ohio 
State University, the Audit Office is satisfied 
that llie Association has incurred and reported 
expenditures properly and that the expenditures 
are in accordance with the purposes of the grant, 
APSA has received $3,280.82 gross income and 
$756.06 net income from the sales of the 
monograph entitled "Comparing Political Fx- 
periences, " from the period May 1974 to March 
1975, under grant GW-G810, The Audit Office is 
of the opinion that APSA has handled this in- 
come in accordance with NSFpolicies set forth in 
NSF Circular 106, 

APSA budgets were generally prepared on the 
basis of "level of effort" for time periods rather 
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an on specitic project activities; as orDecernber 
31, 1974, certain budgeted line' items were either 
over or under expended when compared to actual 
costs. It is the opinion^f the, Audit Office that 
APSA should review its budgeting procedures 
and take steps wherever possible to establish 
procedures so that specific objectives may be 
compared with budgeted and actual expen- 
ditures and performance. Also noted was the fact 
that the NSF fund balance and cash on hand as of 
December 31, 1974, totaled $73,242.14, which 
was in excess of current needs. APSA was ad- 
vised to review their cash request procedures and 
to conform to NSF regulations concerning grant 
funds. 

With, the exception of those comments concern- 
ing the review of project performance and ex- 
cessive cash on hand, it is NSF opinion that the 
financial transactions of GW-6810 have been 
properly handled in accordance with Foundation 
policies and other applicable Government 
regulations. , 

Individualized Science 
Instructional System (ISIS) 

ISIS has- been supported the National 
Science Foundation since September 1972 by 
grant GW-7645 to the Florida State University, 
Tallahassee. The objective of the grant, as stated 
in the grant award letter, is to provide support for 
the development of a multidisciplinciry high 
school science system. Funding hns been provid- 
ed as follows: 



D;iti! of Avvnril Prriml Ainnunl 

I 9/29/72 1)' 1/72 - 30 74 S290.000 

••3/05/73 55,000 

6/08/73 60,000 

8/17/7:1 772.700 

1.177.700 

6/28/74 7' 1/74 - 0. :U»'7e> . 1.(594.905 

12/05/74 480.500 

' ..... . .. 2^^yt5;:,n- 

S:J.353.105* 



_* DeldiliiiLtApffjjdi Lo.ri?s iivv oii^ nj*':... _ ; 

The purpose of the reviow wns to ( I ) rnview tho 
expenditures made under thogriinl, (2) determine? 



that the expenditures reported to the NSF were in 
accordance with the records of the University, (3) 
review the administrative procedures and ac- 
counting qontrols of Florida State University 
(FSU), and (4) review the income aspects of the 
grant. * 

Accordingly, the administrative procedures 
and financial controls were discussed with the 
Provost of Florida State University and members 
of his staff, and the financial control records of 
the University were examined to verify the 
amounts reported to the NSF. FSU is under the 
audit cognizance of DHEW, and therefore the 
purpose of the on-site reveiw was discussed with 
the DflEW auditors. Their most recent com- 
prehensive audit report is for the year ended June 
30, 1970. In this report, DHEW recommended 
strengthening FSU grant and contract accoun- 
ting controls; accordingly, discussions were held 
with FSU on improvements made in these areas 
since 1970. The scope of this examination also in- 
cluded a review of ISIS budgeting procedures, 
publishing agreements and royally and income 
policies. 

As a result of this review and examination of 
the financial controls maintained by FSU for 
ISIS, it was determined that FSU has incurred 
and reported , expenditures in a satisfactory 
manner; based on DHEW review and the im- 
provements resulting therefrom, the Audit Office 
is satisfied that the costs are proper and in accor- 
dance with the purposes of the grant. As far as it 
Wcis able to.be ascertained, FSU has received no 
grant income from GW-7645; and that if any 
graAt income should be received it will, according 
to the Provost, be handled in accordance with 
NSF policies. 

Concerning FSU budgeting procedures for 
ISIS, the grant is primarily a "level of effort" 
grant wi.th the ultimate objective of producing, 
testing, revising and distributing 80 minicourses. 
The principal investigator advised, that the 
budget amounts were basically estimates which 
were, pot supported by detailed documentation 
except in the case of personnel. The Audit Office 
npinionisrthat FSU should be entrouragfTdioiden^ — 
tify more specifically the program objectives lor 
the budget period so that better estimates of re- 
quired funds may be available. 

Ex])i3irdiTljrrrs~nfpr)rTi;d"f(5Frh¥lw 
period ended September 30, 1974, were $138.(346 
less lhan the budgeted and funded amoiin'is. No 
evidence was found iri'NSF files, however, that 
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~These^ uriexpenBeH September" 30, 

1974, wereconsidered in establishing the funding 
for the subsequent period. Although the in- 
vestigation indicated the carryover of $138,646 
was handled, satisfactorily by FSU, the NSF 
program office should have considered and ac- 
counted for this carryover in funding the subse- 
quent budget. 

Under the publishing agreement with Ginn & 
Company, a fund of $425,000 will be established 
by the company for a Teacher Training Fund. The 
• fund is a fixed commitment by the company and 
it is not related to sales of minicourses. Costs of 



tecichef orfOnlTitidh and t rainuigTor ISIS shall be - 
charged against this fund, which^ will be ad- 
ministered by the author (FSU) and the 
publisher. According to the principal in- 
vestigator, NSF has no authority over the use of 
thi? fund. 

With the exception of those comments concer- 
ning FSU budget preparation and NSF actions 
concerning carryover funds, the NSF Audit Of- 
fice is of the opinion that the financial transao- 
tions'of GW-7645 have been properly handled in 
accordance with NSF policies and other 
applicable Government regulations. 
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Appendix 6 



Included in these appendix are two studies commissioned to 
provide background to the Science Curriculum Review Team. . 

The first study "An Analytical Summary of Knowledge About 
Curricula Implementation in U.S. Schools" by Linda Sikorski of the 
Far West Laboratory for Educational Research and Development 
describes some of the factors that influence the adoption and use of 
curriculum innovations and explores how some of the findings from 
studies of the variables have been applied to promote the spread and 
implementation of specific curriculum innovations. 

The second study "Commercial Curriculum Development and 
Implementation in the United States" by BCMA Associates. Inc., was 
commissioned to provide professional insight into the interests and 
practices of the commercial publishing industry in pre-coUege. 
science curriculum development and implementation. It is almost a 
mini-history'of the impact research and development programs fund- 
ed by the Federal Government and other sources have had on 
educational publishers. ^ 
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AN ANALYTICAL SUMMARY OF KNOWLECGE ABOUT 
CURRICULA IMPLEMENTATION IN U.S. SCflOOL 3 



[ Linda A. Sikorski 
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April 29, 1975 
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An Analytical Summary of Knowledge About Curricula 
Implementation in U.S. Schools 

Linda A.' Sikorski 
April 29, 1975 



A count of factors that have been found to influence the adoption 
and use of curriculum innovations would probably reach the hundreds, 
arid isolated effects can usually be" altered by introducing other 
variables which interact with the original ones studied. Neverthe- 
less, certain results are fairly well established at a level of 
abstraction which gives them some value as guidelines--that is, 
they hjave action implications for educational change managers. This 
paper explores these findings and shows how they have been applied 
to propiote the spread and implementation of specific curriculum 
innovations. The focus is on implementation, or sustained use, of 
innovations. 

It should be pointed out that researchers have yet to agree on a 
definition or set of criteria for what qualifies as "sustained use" of a 
curriculum innovation. . There are disagreements regarding how much 
deviation can be permitted before the original curriculum is no longer 
the one in use, how much time must pass to qualify as "sustained, ' 
whether the entire curriculum or just part of it must be used, and 
so forth. In addition to these unresolved definitional issues, there 
is also the problem that very little high-quality, generalizable research 
on sustained use has been carried out. Within these limitations, this . 
paper discusses the evidence which does exist, using a broad enough 
concept of implementation to include most studies where there is some 
evidence of use over at least a short time period and with at least 
minimal fidelity to the original curriculum innovation. 

While many factor's act and interact to promote or impede educa- 
tional change, it is useful to begin by referring to the form or nature 
of the innovation itself. It has been fairly well established that 
tangibility, flexibility, radicalness and disruptiveness of innovations 
ai'e important. T6 illustrate, a new science textbook is more tangible 
than a . new approach or method for teaching science. A simulation 
game which is useable in n^any ways and in many settings is more 
flexible and adaptable than a rigidly programmed innovation.' Inno- 
vations such as Prug Education or Sex Education curricula are 
considered in many sphool systems to be highly radical, as compared, 
to say, a new i*eading program. Moveable classrooms, new organi- 

zational arrangements.. ajad_lLexible-.s-c hcdu I ing -rep res-en 1 d is-ruptive" " 

innovations, innovations that don't fit easily into the existing structur'c. 

A series of case studies of the diffusion of educational innovations 
has shown that tangible, flexible innovations which do not employ 
unfamiliar or disruptive media or methods are quite readily accepted 
by schools and quite successfully implemented. (Turrabull et al 1974. ) 
Other investigators have confirmed that non- radical, simple products 
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are more easily implemented by schools (Miller 1974; .Widmer 1975; 
McCune 1974), and' numerous studies show a negative relationship 
between disruptiveness of- innovations and the implementation of 
those innovations in schools. (Lindeman et al 1969; Miller 1974; 
McCune 1974; Widmer 1975. ) 

In a review of over 50 studies of innovations (mostly non-educa- 
tional), Rogers and Shoemaker (1971) show that successfully adopted 
innovations are more communicable (i.e., observable, tangible), 
compatible, trialable, and divisible (i. e. , flexible and adaptable). 

A new math text which has visibility and is easy to understand 
would be quite "communicable. " A concept, such as individualized 
instruction* usually is not. Similarly, the.textbook is likely to be 
compatible with system patterns and. values, where individualized 
instruction may not fit so easily. An. inexpensive series item, such 
as National Scholastic , is trialable. i. e. can be tried out before a 
major commitment is made, and divisible, i.e. can be used in part. 
A complex innovation such as closed-circuit TV does not have as 
much flexibility. 

The action implications are t^irly o6vious--if curriculum innova- 
tions can be developed as tangibles non-radical, non-disruptive, 
flexible products, schools can adopt and successfully implement them; 
dissemination efforts can be focused on pron^otion, to develop aware- 
ness and interest on the part of potential users. 

However, little meaningful educational change is mediated by ; 
products with all of those attributes (a point carefully developed by 
Baldridge, 1974). Curriculum innovations are usually Complex, often 
abstract,^ often radical and disruptive, and sometimes inflexible. 

The successful implementation of such innovations is generally 
considered to require a <iegree of change capability and motivation not 
typically found in schools. In general, factors found to be important 
can be roughly grouped in two ca^tegories: Planning/ Evaluation and 
Organizational Structure. ^fTi^ implications drawn from findings m 
those areas usually relate t(>4^raining for school personnel to assume 
new roles and conduct new programs; to linkages, or institutional, 
psychological, or interpersonal ties to outside sources and 
resources; and to incentives, for change-related behavior and 
participation. . ' 

_ -Factors Associated wltii. a -Planning and Evaluation Capability . 

We are learning that systematic planning and evaluation are critical 
for educational change. They have been found to relate positively to 
continued use of innovations adopted by schools receiving Title III 
- a3sistance-(Widm^r 1975; Miller 1974), to the number . of innovations 
reported being used in their districts by a sample of 400 superintendent 
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(Mavelock 1974), and to effectiveness of curriculum implementation 
(in research reviewed by Pierce, 1974), ' 

However, findings in this area are uneven. As regards planning, 
Widmer (1975) reports that for Massachusetts Title III projects, 
continuance and the existence of an initial needs asssessment were 
not related. Schools which carried out needs assessments did not 
seem to benefit from them. 

CrandalL (1974) reports that planning doesn't always facilitiate 
change and that, in fact, it may be used to postpone making an action 
decision. 

The suggestion here is that planning is not automatically helpful, 
but that it must be streamlined and effective. Very likely the finding 
reported by Widmer (1975) regarding needs assessment is due to 
the fact that where needs assessments we re conducted, they were 
done to justify rather than prescribe the "solutions'* represented by 
the innovations being adopted. This kind of planning focus is probably 
a chief reason that education is so replete with "faddish jargon and 
'shortlived inno\'ations. " (Sieber ' 1975), , ^ 

Vet^y likely, future research will show that improved planning 
relates to continuance, in part because it enables schools to transform 
or avoid what are right now he^ld to be almost insurmountable problems 
in curriculum innovation. For example, adequate planning in regard 
to a curriculum adoption would allow for early amelioration of the 
radicalness of a new product, or for accommodation to its disruptive- 
ness, before these come to generate resistance. 

Case studies of alternative sc:hools show that one problem with 
the movement has been poor planning (Deal 1975), Fairly logical 
negative outcomes were not anticipated, and when they occurred, 
survi\'al of the school required retrenchment and svstematic planning 
for further* dev elopment, 

It follows that one of the most impoi'tant func:tions for planning 
is to develop clear, visible change goals. Where goals are realistic, 
limited, and clearly understood by participants, curriculum innova- 
tions are more easily and effectively implemented. (Widmer 1975; 
McCune 1974; Pierce 1974; Pincus 1974,) 

As regards the evaluation function, findings here are also uneven. 
Despite the empirical and logical evidence for its value, at least four* 
investigator-s present cautions, Havelock's (1974) survey of superin- 
tendents finds a slightly negative relationship between innovations and 
evaluation. Miller (1974) reports for Title [II projects in California 
that less money allocated to evaluation related positively to project 
continuation, Flavelock speculates that evaluation may serve to dampen 
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the innovative spirit when it documents the limited immediate impact 
which is characteristic of curriculum innovations. If this is in fact 
occurring, it can probablyCbe attributed again to poor planning, to 
the failure by planners to anticipate outcomes realistically, and to 
prepare participants accordingly. 

Pincus (1974) cites the inflated expectations for short-term 
^'experimentation" with educational innovation as a chief reason not 
only for failure, but for the perpetration of resistant postures on 
the part of school personnel. 

Glass (1975) dicusses another serious problem with evaluation, 
one he calls "evaluation anxiety. " He points out that efforts which 
should be directed toward installing and implementing innovations 
may instead be spent in developing defenses. Ag^in, a function for 
planning is to prepare for and accommodate evaluation, and part of 
this involves developing constructive and realistic attitudes as well 
as designing evaluation which is oriented to improving rather than 
dismantling new systems. 

This brings us to a key factor in effective planning and evaluation, 
which is the early and meaningful involvement of those who will 
implement change. 

Innovation is facilitated by the meaningful and early involvement 
of those who will implement change and it is seriously hampered when 
participants-are not involved. (FuUan and Eastabrook 1973; Widmer 
1975; TurnbuU et al 197.4; Havelock 1974; Miller 1974; Lin et al 
1966; Schmuck et al 1971; Pierce 1974. ) 

Blanzy (1974) describes the need for active involvement of school 
staff during innovation/ implementation: 

"The staff must not only develop the technical competencies > 
to employ the innovation but be allowed to provide feedback 
as to its use and effectiveness and must in turn be provided 
with continuing support. " (pp. 46-47). 

Studies of R&D products and programs with high impa\ct have shown 
continuous, open communication with user representatives throughout 
the developmental effort (TurnbuU et al 1974) and the obtaining of 
^arly commitment from actual users (Widmer 1975). If the key 
participants are not meaningfully involved, they may fail to effectively 
implement change, in certain cases even acting to sabotage it. 
(TurnbuU et al 1974; Hall and Rutherford 1975.) 

It is ndt enough to simply consult with or ask the approval of those 
who will implement change- - rather, they must be actively involved 
in shaping change, there must be real resolution of conflicts and 
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differences, and there needs to be meaningtul collaboration among 
key actors. 

Far West Laboratory studies of school decision-making and 
problem-solving (Coney, et al, 1968; Chorness, et al, 1968a; 
Mosher, 1968; Carlisle, et al, 1971); other research (Miles, 1974; 
Havelock, 1974; Miller, 1974; McCune, 1974); reviews of literature ^ 
(Chorness, et al, 1968b; York, 1968; York, 1970); case studies 
of the diffusion process (Turnbull, et al, 1974); and field tests of 
practitioner-target information packages and systems (Hutchins, 
, 1970; Ng, 1970; Sikorski, et al, 1971; Hutchins, et al, 1970) indicate 
that significant educational planning and decision-making in schools 
must be a collaborative effort--an important finding, since schools 
do not typically exhibit "collaborative norms." 

Knight and Gorth; (1975) have found that innovators in schools 
usually comprise a very small group, and there is little spread 
beyond that. Teachers are isolated from administrators and from 
each other (Smith and Sandler, 1974; Stiles-and Robertson, 1973). 
This works against the effective implementation of new curriculum 
innovations. 

Organizational Development theorists are concerned with creating 
climates whicii ^r-f- supportive of change, which maximize participa- 
tion and institutionalize planning capabilities. (Schmuck and Miles, 
197.1; Schmuck et al, 1972. ) This is a formal statement of the notion 
that a critical precurser to the implementation of complex curricululm 
alternatives is the instilling or improving of the planning capabililv, 
including increased participation. Even at the level of the individual, 
factors related to innovati veness are usually those- which have to do 
with a person^s activity and ability levels;^,characteristics such as 
level of education and Job satisfaction (Knight and Gorth, 1975). At 
the organizational level, findings suggest that maturity and experience 
with innovatioas are important (Baldridge, 1974; Deal, 1975; Denham, 
1971;Widmer, 1975). Thus, as noted^earlier, typical approaches 
to the problem of implementation of ^curriculum stress training (for 
example, Tempkin, 1974). The 11 Far West Laboratory case studies 
(^rurnbull et al, 1974) provide empirical evidence that this is important; 
it is stressed that adequate incentives for.both trainers and trainees 
are vitally n^^cessary. 
I 

Tempkin and Broun (1974) summarize the implication of rescar-ch 
in this area as follows: 

"R&D deliver^v strategies aimed at br-inging researc^h findings, 
knowledge and produ(^ts to the schools have less potential for 
change. than those strategies that emphasize strengthening the 
capabilities of school districts to actively be responsible for 
their own improvetnent. " (p. 22) 



126 

ERIC 



- '6 - 



Factors Associated with Organizational Structure . The nature of 
the school organization has much to do with the process of curriculum 
implementation. Baldridge (1974) reports findings from six research 
projects sponsored by the Stanford Center for Research and Develop- 
ment in Teaching which show that structurally complex and large-size 
organizations generally are more innovative, i.e. adopt new programs 
and practices more often. Complexity here refers to the number of 
specialized units, administrative positions, and organizational sub- 
sections, and size and complexity are closely related. 

He explains that size and complexity are indicators of the school's 
capability for absorbing change. This is consistent with the first 
part of this discussion, whichjmplies that schools which can, do, 
i.e, that capability for innovation is associated with innovation. 

Baldridge's discussion goes on to suggest that structural complexity 
in schools .should be increased, to make them more receptive to change. 

However, Zaltman et 'al (1973) review studies which show that 
while organizational complexity favors the adoption or initial accept- 
ance of innovations, more complex organizations have less success \ 
implementing change. This Jibes with Havelock's (1969) description 
of complex division of labor as an '-inhibitor" of knowledge flow in 
organizations. Zaltnian et al explain that the decentralization and 
specialization which allow innovations to more readily permeate system 
boundaries, act against the innovation being able to easily fit existing 
patterns- -further, they suggest that guidelines provided through clear 
structure and authority are needed by participants in, a novel situation. 
They present evidence that formalization, or the cla^rity and compre- 
hensiveness of rules and regulations, is positively .related to imple- 
mentation (although negatively related to adoption). This is consistent 
with Robertson^s (1971) finding that programmed innovations are more 
often successfully implemented. 

This is also supported by Deal's (19J5) case-studies of alternative 
schools. He found that the reason for crisis and failure of these, 
arrangements lay in their disruption of esJtablished authority patterns. 
Those schools which ultimately succeeded were the ones which adoptedj 
an authority structure with role clarity and a definite division of labor. 
Where the initial structure had been, 'do what you please, '^'^ the new 
structure was,' "do what you and I have jointly established. " 

Baldridge's (1974) report of a New York ca'^e study includes 
the finding that clear cut authority structures facilitated^ change. 
Havelock (1969) describes clear authority pc ^rns as a "facilitator" 
of knowledge flow in organizations. i 

Knight and Gorth (1975) report findings that indicate that change 
can be mediated bv organizational sanctions, and they suggest that 
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change roles should be instrtutionalized such that there are incentives 
and authority patterns relevant to effective conduct of these roles. 
This suggestion is not new (see, for example, Carlson, 1965, and 
later, Baldridge, 1.974), and it is consistent with our knowledge that 
the educational establishment does not now favor risk and innovation, 
that change participation frequently must be at the expense of spending 
time accomplishing more accepted goals. (Stiles and Robertson, 1973; 
Knight and Gorth, 1975. ) If incentives and a rationale for it were 
to be institutionalized, participation should increase. 

There is, how^ever, at least one caution in this regard: where 
authority patterns and organizational sanctions are activated to 
command change behavior, change may not be sustained over time 
or may be somehow sabotaged by participants. (Zaltman, 1-972; 
TurnbuU et al. 1974; Hall and Rutherford, 1975. ) Where participants 
are acting not through a commitment to the curriculurn innovation but 
rather to achieve some other reward or avoid some negative outcome, 
change behavior will last only so long as the other, outcome remains 
salient; in addition, it may require vigilance oyer' time,\ In general, 
then the motivation for change should include at least some commit- 
ment to the change; again, the importance of early and meaningful 
involvement of users is underscored. 

Another aspect of school structure which is related to curriculum 
innovation is that of external contact. Much reported research con- 
firms that external contact and openness of an adopting system play 
an important role in change. (Klingenberg, 1966; Tempkin, 1974; 
Hawkins, 1968; Johnson and Marcum, 1969; Crandall, 1972.) 

It seems logical that isolation should work, against innovation; 
certainly this has been found to be true, at the individual level, where 
innovation adoption tends to follow friendship pattern^ (Carlson, 
l'9l35; Eibler, 1965; Hughes, 1965) and professional meetings and 
interactions are found to be used more by more innovative individuals 
(Carlson, 1965; Hage and DeWrr, 1971). 

'At the organizational level, Baldridge (1974) reports research 
findings confirming that organizations with viable linking mechanisms 
to their environments adopt more innovations.. 

For one thing, individual scliools and school districts often lack 
the necessary manpower and resources to coordinate and trouble- 
shoot the implementation of complex innovations. . 

Further, Hav^lock (1974)' found that schools "reinvent many 
wheels" when they are not in contact with other systems with relevant 
knowledge and experience. Just as practitioners are often isolatetl 
within schools, schools and districts are also isolated, if not so much 
from influence and pressure groups, then from resource systems 
(Stiles and Robertson, 1973). 

/■ ■ 
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Because of this, there is concern with developing and improving 
linkage systems to break down isolation. Th'is is partly a mechanical 
problem, one of setting up communication channels. But it is also a 
psychological one, sidace practitioners in many areas have' institution- 
alized isolation, using it for protection (Pincus, 1974). 

■ Thus, we come to the importance of incentives. For curriculum 
change to succeed, it is important that the incentive structure be geared 
to openness and risk-taking (Turnbull et al, 1974). 

In summary, the factors associated with the success or failure 
of curriculum innovation have generally to do with aspects of capability 
and motivation, particularly as regards change planning, and with 
aspects of organizational structure. To increase receptivity of school 
systems, change managers have used the tools of training and organi- 
zational development, incentives, and linkages. 

' Operating Models for Curriculum Implementation . Current models 
for the installation or implementation of specific curricula usually 
apply principles based -on the research reported here. Most of them 
recognize the importance of training. Many are concerned with 
improving planning/ evaluation capabilities and with incorporating 
or increasing the early and meaningful involvement of the key actors 
in change.. 

Within this general pattern, there are variations. Sometimes 
training is narrow in scope, involving only the teachers and other 
individuals who will actually use the curriculum. In these cases, 
training focuses on instructions tor use. On a broader level, training 
may be aimed at developing general professional competencies, such 
as evaluation skills, so that use not only of the specific curriculum 
but of other innovations as well is improved. In these cases, usually 
the target of training is the entire school or district. Between these 
extremes, there are a variety of approaches. For example, there 
may be the goal of improving teachers' basic science knowledge to 
enable them as users of a science curriculum to do a better job 
teaching it. Or administrators -may receive planning skills which they, 
are expected to use in increasing teacher participation. 

Additionally, there are various applications of the use of incen- 
tives associated with training or other activities, (e. g. coordination) 
necessary for implementing an innovative curriculum. For example, 
direct rewards such as financial renumeration or academic credit 
may be offered. Or, distributors 'may attempt to instill attitudes 
conducive to effective change, so that teachers are personally and 
professionally committed to achieving certain outcomes. 

Sometimes distributors require broad participation in decision- 
making by all parties involved by not allowing schools to adopt without 
evidence of consultation with teachers. More often, conferences 
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or other vehicles for participation are made available but not 
required. In some cases, there is no real concern for this variable; 
distributors may feel this is irj<the schools area of responsibility. 

Most distributors are concerned with establishing linkage, 'to 
tie individual practitioners with each other,, and to link schools, and 
districts with resource systems. Sometimes regional representatives 
actively contact and interact with users or potential users; often, 
they are simply available, usually By phone or mail, ^to provide 
training or other implementation assistance. Linkage systems may 
be extensive, involving many different resource and user systems, 
or more limited, involving only program users and program developers. 

Applications of these principles include models such as the South- 
west Regional Laboratory (SWRL) model; the Biological Sciences 
Curriculum Study (BSCS) Human Sciences Program model; the Model 
for Individually Guided Education (IGE); a Northwest Regional Educational 
Laboratory Model; the New School Model; the Educational Extension 
Agent Model; and a model out of Research for Better Schools (RBS). 

The SWRL model for implementation assistance stresses training 
in program management as well as use, thus addressing /the need for 
planning skills. The developer provides materials and procedures 
for implementing SWRL instructional programs; the respons.ibiity for 
conducting training is mainly local. The developer helps initiate, 
but the adopting system is expected to take over. Consistent with 
the findings from research, the system is concerned with the quality 
of instructional planning as much as with the instruction itself; with 
initiating and evaluating the program. However, incentives intended 
to operate for trainers and coordinators, and for teachers (trainees), 
are mainly organizational sanctions; if the program is adopted, certain 
roles are to be assigned or designated. There are no clear incentives 
beyond this, and a system for maintaining organizational vigilance 
is not specified. Thus, instructional improvement is the main 
motivator to the extent that it is operating. The earlier discussion 
in this paper would suggest that obtaining involvement and commit- 
ment from all participants' will be extremely crucial for this model. 

The BSCS;Human Sciences Program is a complex and radical 
curriculum innovation. A diffusion model currently being tested is 
closely tied to Havelock's (1969) conception of linkages. This model 
stresses collaboration among users in a social influence system, the 
ultimate in oarticipation and involvement- -including resource systems, 
linkers, and user systems. All groups affected by cyrriculm changes-- 
even including parents--are represented on a Pissefii irtation and Implo- 
/mentation (D&I)^Team. which is conceived as* a .link between users 
and developers as well as a vehicle for participation an<d involvement 
of user groups. The D&I Center is a resource system for the user, 
along with other systems such as the government sponsor and the 
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distributor. Thus, the centers are? intended to establish effective 
linkage with schools in their regions, ultimately developing a stable 
social influence network for collaboration. 

IGE and the Multiunit School are two versioni? of an organizational 
arrangement for nongra'ded instruction. This is a complex, disruptive 
innovation which involves' the entire school building. Inservice training 
is the key to a school's implementation of either version, but it is 
not the only form of implementation support. 

The developers hold conferences with representatives of all 
groups who will be affected by the innovation (including the community 
'and the school board) prior to the time a decision is made. Thus, 
there is early involvement by key actors. This does not automatically 
insure that they will be committed, but there is the hope that schools 
will not decide to adopt until there is substantial agreement. . 

Schools deciding to use the system sign formal agreements for ' 
inservice training. ^ The developers" provide the training through 
linking agencies, and it has been designed to promote professional 
growth, as a broad concept, rather than program specific skills. 
Thus, incentives for trainees have been considered. Trainers receive 
financial renumeration. 

Schools are or-ganized into leagues, in an effort to promote resource 
.and idea sharing. 

The Northwest Regional Laboratory Model for Research Utilizing 
Problem Solving (RU^ES) Tor mservice training. for plannmg skills, 
zeroes in directly on the need for planning skills. It focuses on 
training, to instill the capability for implementing RUPS. 'Addition- 
ally, the model involves "do-it-yourself-dissemination," where trainees 
become trainers. Thus, the model depends on collaboration among 
participants. Additionally, a network of regional representatives 
is maintained to provide initial training and as a resource system 
for users. 

There are incentives for network personnel, since they receive 
financial renumeration for services. However, there are no concrete 
incentives for trainees to become trainers, and there is no particular 
provision for facilitating collaboration. 

The New School of Behavioral Studies in Education lasted from 
1968-197:^ and provided teacher training for individualizing instruction ' 
in North Dakota. Incentives for developing skills were mainly in the 
area of professional development for less -than^degree teachers 
(preservice training). These teachers are expected to use the method 
and spread the word. Developer's fourtd that isolation within schools 
' works against this, so they tried to arrange- for more than one teachei* 
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from a particular school to take the training together. Also, field 
agents visited schools- - rather than serving as more passive 'resource 
systems. 

Currently, the method, is being carried out by the Center for 
Teaching and Learning at North Dakota State University. It addi- 
tionally tries to involve all different levels of the school system in 
using innovative methods through workshops and other means devised 
and carried out by regional representa'tives who act as liaisons. 

One" appro a'cVT t o th e~p r o b I e m t ha r^cTiool* s~ancr "d i sT r i c t s"^ e ~ 
isolated was the Educational Extension Program funded by OE to 
link schools with relevant resource systenris through field agents. 
Agents also served to help schools improve their planning and 
problem solving capability in reference to specific problems. 

The system never completely solved the problem of incentives 
for State Educational Agents (SEAs) to serve as linkers qr the 
problem that the system was not used to the extent'neceasary to 
demonstrate significant change in schools--suggesting again the 
need to insure incentives for breaking out of the isolation mode and 
to develop capabilities for curriculum reform. 

A related project is currently being funded and involves the linking 
of potential users of specific exemplary programs with demonstrators 
and field agents to conduct needs assessment and other planning as 
well as to facilitate adoptions and assist in implementation. 

The RBS Strategy for IP! (and other RBS programs.) is also* 
concerned with strengthening planning for innovation. A network of 
school districts linked to SEAs provide demonstrations, after training 
for improved planning skills as well a3 for implementing the product 
in question. In addition, they stress evaluation and quality-control, 
pi'oviding the feedback system for monitoring. 

RBS recognizes the usefulness of. participation and tries to involve 
everyo/ie in training, planning and needs assessment, and evaluation. 

Problems in Comparing Models . It is difficult to assess and 
compare the effectiveness of these and other models. P'or one thing, . 
the situations in which they are applied allow little or no experi- 
mental control. These are operating models, which deal with dirterent 
innovations and in constantly changing circumstances. The models 
themselves are being continually revised. To' compare the SWHL 
and Northwest Regional Laboratory models, for example, would be 
to ignore the vast differences in the innovations being implemented, 
the environments being dealt with, the requirements for imple- 
mentation, the skillfulness with which programs are conducted, 
all of which may have more to do with outcomes than any of the 
implementation methods being employed. 



/ 13i 

132 



- 12 - 



A second factor which makes comparison •difficult is the problem* 
of determining success. In general, most distributors claim success, 
basing it on elaboration of favorable cases, if that is appropriate, 
or on presentation of sales data, if that is favorable. But a weakness 
shared by all the models is that research on classroom utilization,^ 
on what>ctually goes on at the level of the student, is practically 
non-existent. In effect, we generally do not know first, how teachers 
actually use these curricula, i.e. whether they teach. all or part, 
how faithful they are to developer's strictures; and second, how 
these curricula influence student behavior. Developers, frequently 

_ha-v€- not really-defined-what -teachers-should-be- doing, -and 

researchers--partly for political reasons and partly because of 
methodological inadequacies--shy away from uspg measures of 
student outcomes to document the success of programs. There are 
exceptions-- for example, the Far West Laboratory's Minicourses 
are being researched for effects on students--t)ut, in general, 
researchers and developers* both have avoided questions about student 
outcomes; / 

^ Another major weakness generally sharejd. by the models has to 
do with how individual and group commitments can be strategically 
developed and systematically maintained. Right now, this kind of 
commitment is frequently accidental, based on coincidence of the 
program with strong user values. Particpation and involvement are 
usually necessary for commitment, but th^se are not sufficient. 
There are not yet good answers to the questions, how do you get 
the commitment of teachers individually and as groups? How can 
other 'key actors be^motivated, to implement a curriculum alterna- 
tive? How can school and district decision-making be influenced to 

favor conamitment? 

• I 

Again, this is a question, involving /incentives and linkages; 
incentives are the basis for commitment and linkages are vital 
' for maintaining support and implementation capability. One of the 
current issues faced by federal policy-makers involves the question: 
How can projects be influenced to continue when" federal funding for 
incentives and linkages is withdrawn? 

So far, the best suggestion researchers can offer for obtaining 
commitment is to involve users as early as is feasible--in the develop- 
ment stages, if possible--and to be responsive at all development -and 
implementation stages to their particular needs. Additional processes 
for mediating commitment are^not yet clear. 
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COMMERCIAL CURRICULUM DEVELOPMENT AND IMPLEMENTATION 
IN THE UNITED STATES 



Background 

BCMA Associates , Inc., is pleased to submit this 
report to the National Science Foundation in response to Purchase 
Order No. 75-SP-0867, Requisition No. 61422, dated April 18, 1975. 

General Information Concerning School ("El-Hi") Publishing 

Instructional materials for elementary schools 
(pre-kindergarten through grade 6 or 8) and high schools' (grade^7 
or 9 t^irough 12), customarily referred to as "el-hi" publishing, 
constitute the largest segment of the educational publishing indus- 
try, with estimated annual sales of close to $1 billion. 

El-hi publishers develop and market instructional 
"software" in a variety of medla^, print and non-print, designed pri- 
marily for per-student, per-classroom, or per-school use in public 
and nonpublic schools ranging from pre-school day-care and early- 
learning centers to public and private secondary schools providing 
for a variety of student needs. 

Well over half of this estimated $1 billion re- 
presents the sale of elementary and secondary textbooks and workbooks 
(clothbound and paperbound); the balance includes a great variety of 
other instructional software: non-standardized test booklets; stan- 
dardized tests; magazines designed especially for instructional use; 
8mm, 16mm, and 35mm motion pictures; filmstrips (sound and silent); 
overhead projection transparencies and masters; duplicating masters; 
slides; audio tapes and cassettes; phonograph records; study prints; 
games; manipulative learning aids; miscellaneous boxed materials; 
multi-media kits. 

El-hi sales are understated to some extent, how- 
ever, because many products not specifically designed for instructional 
use in schools but nevertheless purchased for such use (e.g. college 
textbooks; adult and juvenile "trade" books ; adult magazines; feature 
motion picture classics) are not included in the industry*s annual sta- 
tistical surveys made by the Association of American Publishers (AAP) 
and the Educational Materials Producers Council (EMPC) . In addition, 
the products of a relatively large number of small educational pub- 
lishers and producers are not fully represented in these surveys. 
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Although 



close to $1 billion in annual sales may 



seem large, it is considerably smaller than the annual sales of each 
of many dozens of United States corporations, including some that 
^own el-hi publishing companies. Also, when translated into annual 
sales per student and per school, the figure does not seem nearly so 
impressive. As reported in the annual AAP survey, for example, the 
per-student expenditure for printed instructional materials in 1973 
was approximately $10.35. / 

The largest percentage of el-hi publishing re- I 
venues comes from the saie of basic instructional programs in the 
major disciplines, published by the school divisions of^. large (in 
terms of the industry)^^ publicly-held companies, or by el-hi companies- 
that are subsidiaries- or divisions of non-publishing corporations. , 
The industry provides ample room, however, for many much smaller com- 
panies that develop and market new products (often innovative, some- 
times of very high quality) with speed, ingenuity, an eye for special 
instructional needs, and a modest iijitial investment. El-hi publish- 
ing, in fact, consists of a relatively large number of relatively 
small companies. 

This aspect of el-hi publishing is well illus- 
trated by the following representative list of A3 companies, all of 
which are important factors in one or more subject-matter or basic- 
skills areas in el-hi publishing. They range, however, all the way 
from small, inde^pendent firms to relatively large school divisions or 
subsidiaries owned by much larger parents, some of them non -publishing 
corporations. For convenience, we have listed all these 43 companies 
and divisions separately on the next page (3) . 

The 12 companies starred are generally considered 
to be among the largest el-hi publishers of basic instructional materials 
(though not necessarily the largest publishers). All 12 possess the 
ability, the resources, and the inclination to deivelop and disseminate 
basic multi-media instructional programs that require the expenditure 
of up to several million of their o\m development and production dollars, 
and up to five years or more of effort, before a single item is sold. 
The entrepreneurial boldness of many smaller companies, however, is 
indicated by the fact that a very small publisher (not even on the 
above list, but known to the authors of this report) raised the necessary 
funds and spent about $750,000 over a period of three years to create 
and place on the market an alternative basic reading skills program 
for grades 1 to 8. 
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*Addison-Wesley 

Allyn and Bacon 

American Book Company (Litton) 

AMSCO 

Benziger Bruce & Glencoe (Macmillan) 
Bobbs-Meri-ill (ITT) 
Economy / 
Educational Development Corpi 



Encyclopaedia Britannica 
Educational Corp. 



Fearon (Pitman) 
Follett 

*Ginn (Xerox) N 

Globe (Esquire) \ 

\ \ 

*Gregg Division (McGrawKHill) 

Grolier Educational Corp. 

*Harcourt Brace Jovanovich 

Harper & Row 

D. C. Heath (Raytheon) 

*Holt, Rinehart & Winston (CBS) v 

Imperial Intcrnat i onal Learning 

Laidlaw (Doublcday) 

*Houghton, Mifflin 



, J . B- Lippincott f- 
*Macmillan 

: McCormick-Mathers (Litton) 
Charles E. Merrill (Bell & Howell) 
National Textbook 
Noble and Noble (Dell) 
Open Court 

Pflaura (Standard Publishing) 
Pitman 

Prentice-Hall 
Rand-McNally 

Random House School Division (RCA) 

William H. Sadlier 

^Science Research Associates (IBM) 

Scholastic Magazines 

*Scot:t Foresman 

*Silvcr Burdett (Scott Foresman) 
'^South-Western (Scott Foresman) 
Steck-Vaughn (Intext) 
^Webster Division (McGraw-Hill) 
Westinghouse Learning Corp. 
Xerox Education Publications 
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Changes in El-Hl Publishing 

Within the past 17 years, dating from the pres- 
sures generated by post-Sputnik reactions to educational problems, 
the el-hi publishing industry has become transformed from publishers 
of "printed materials of instruction" — basic clothbound t:ixtbooks 
(with correlated workbooks, test booklets, and teachers manuals) 
arranged in a graded series (e.g. elementary reading) or for a course 
(e.g. high school biology), and "supplementary materials" (e.g. 
classroom periodicals, paperback books) — into publishers and pro- 
ducers of multi-media instructional programs and system^. Both large ^ 
and small el-hi publishers have been affected by this change, even 
those that are usually classified as publishers and producers of sup- 
pjementary materials designed for "building- level" sale. 

In addition to the catch-up-with- the-Russians 
pressures noted above, the major factors that have led to this dra- 
matic change in el-hi publishing include: the interest (dating from 
about I960) of large, technologically-oriented , non-publishing cor- 
porations in educational publishing; the impact of programmed instruc- 
tion and teaching machines; the great number of government-funded cur- 
riculum projects; advances in "audio-visual" technology; the emphasis 
on developing materials in a variety of media suitable for use with 
culturally-deprived minorities; the emphasis on individualized learning; 
an increasing demand (led by the states of California and Florida) for 
publishers and producers to display valid evidence of the "learner 
verification" of instructional materials being offered for adoption 
(particularly those materials concerned with the development of "basic 
skills" in elementary language arts — reading especially — mathema- 
tics, social studies, and science). 

Reflecting these influences and changes, the 
American Textbook Publishers Institute becamie the American Educational 
Publishers "Institute in the mid 1960's and later the School Division 
of the Association of American Publishers. 
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General Characteristics of Instructional Programs 

As usejd in this report and by el-hi publishers, 
basic instructional materials programs include all the components of 
a program produced to implement the curriculum in a subject such as 
elementary reading, elementary science, secondary school jnathematics , 
or secondary school literature. The components for an instructional 
materials program for a curriculum in the elementary school may in- 
clude a textbook for each grade, with a series of correlated work- 
books and teachers' editions, or it may now be a multi-media program 
that includes a wide variety of instructional materials including 
not only textbooks for each grade but also correlated sound film- 
strips, simulation games, posters, duplicatirfg masters, special 
materials for individualized instruction, and other components. 

Although the components of an Ijistructional 
materials program' differ according to the subject idc which they 
are intended, the learning theory underlying the program, and the 
publisher's design, most large instructional programs are now multi- 
media in scope. It should be noted, however, that such programs 
usually are organized around basic textbooks, whether they are single 
books for each grade or subject, or multi-books. 

It also should be pointed out that the textbook 
is usually the catalytic agent of an instructional materials program 
not only for educational reasons but al^o to conform to the regula- , 
tions of the states with statewide textbook adoptions or listings. 
In the 22 states with statewide adoptions, the call for bids usually 
includes only textbooks and teachers' editions, which the state may 
supply to students without cost. The district may purchase the cor- 
related materials. To meet state regulations and also to provide 
textbooks for selecting committees that want them in a more flexible 
form, publishers sometimes publish the textbooks in two forms: a 
single clothbound textbook for . each grade, and as a ^:eries of unit 
textbooks for each grade. The states with statewide adoptions are, 
however, beginning to close the gap between curriculum trends in- 
volving a system of materials and the regulations that are restricted 
to textbooks and teachers' editions only. 
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Evolution and Revolution 

This change from a single basic textbook In 
each grade for each. subject to mullt-medla Instructional materials 
programs hats considerable relevance to this report because It Is 
transforming, perhaps revolutionizing, all aspects of el-hl publi- 
shing. For example, the development and production of a program 
of educational materials requires careful planning to make certain 
that the whole is greater than the sum of the parts. A multi-media 
program also requires careful planning to make certain the compon- 
ents are developed, produced and delivered on schedule. Their de- 
velopment also Increases the need for classroom testing and at the 
same ^Ime complicates the process. The production and packaging of 
the miterlals to facilitate distribution to pupils as they are needed 
and t^eli retrieval and storage after the pupils have completed their 
use off them, demands new procedures* 

/ Not only has the change transformed development, but 

it also makes new demands on the publisher for implementation. For 
teaZhers to use the materials to their best advantage, the system 
rec^uires carefully prepared teachers* editions and demonstration 
workshops. This change also is encouraging publishers to think of 
themselves not only as publishers of instructional materials but as 
agencies for curriculum development and implementation. A well-known 
publishing firm with a distinguished reputation, for example, has 
recast the editorial department into two Centers for Curriculum De- 
velopment - one located in ^San Francisco, the other in New York City. 

And, last but not least, the production of a pro- 
gram of multi-media instructional materials iTequii^es of the publisher 
a much heavier Investment of capital both to develop and to produce 
the programs. 

The Structure of El-Hi Publishing 

The following brief, highly generalized descrip- 
tion of the characteristic structure of el-hl firms reveals how they 
are organized to carry out the two functions of the development and 
implementation of instructional materials programs. 
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Although each el^t publishing firm has its own 
pattern of- organi/zation, the functions they perform in a sense dic- 
tate^ organizational structures with many coiqfnon features - found in 
.^virtuall^r all companies. And all el-hi publishing organizations re- 
fclect the organization of school curricula./ 



An el-hi division is usually headed by a general 
managers or dep^Atment head. The functional organization usually in- 
cludes ah^editorial director who. is responfsible for the development 
and production of the instructional materials^ programs. For each 
curriculum ar^ for which the publisher piiblishes, there is usually 
an editor-in-chief. For example, an edit(|)rial director may have re- 
porting to him an editor-in-chief in langtiage arts (with perhaps a 
separate editor-in-chief for reading), ani editor-in-chief in science, 
one in mathematics, one in social studies, and perhaps an editor-in- 
chief in foreigh languages or industrial arts or home economics. 
The number of editors-in-chief depends, of course, on the publisher's 
areas of concentration. 

Editor ial ' ■ 

\^ 

The editors-in-chief not only actively engage in 
development, but they also have their own staff of editors to whom 
they assign projects. The number of editors in a subject-matter area 
depend, of course, on the publishing program. A subject-matter edi- 
torial department that has an elementary reading program under develop- 
ment may have as many as thirty editors working on that program alone. 

The curriculum areas may be further divided into 
elementary and secondary, with separate editors-in-chief for each — 
e.g. elementary language arts, secondary language arts, elementary 
mathematics, etc. 

The qualifications ^af' subject matter editors, es- 
pecially of t^e editors- ir-chief, reveal a great deal about the role 
of educational publishers In the development of ins true tibial materials 
^ The editor-in-chief of each discipline, for example, and members 
of his staff, are continually engaged in keeping up to date on the 
scholarly research in the fields of/ their specialization, on the recent 
and current studies of curriculum committees and commissions, on theo- 
ries of learning (especially thos^' of Piaget), and on the external 
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forces that influence curriculum, such ak the demands for reform by 
minorities for accurate representations irtv instructional materials 
of their role in history and of their acliievements and aspirations, 
and by the women's rights movement. To the^ latter forces they must, 
be especially sensitive. As members of professional organizations, 
such^ as the National Science Teachers Association, they not only 
read their publications and attend their meetings, but they also often 
contribute to the publications and participate i^ their conferences. 
They are educators and scholars who specialize in\ the development 
of instructional materials. * \ 

In addition to the necessary skills required of 
any editor, they usually have had teaching experience in the subjects 
for which they are responsible, and often publishing experience 
that may include selling as well as editing instructional materials. 
Almost all hold^ graduate degrees either in a discipline or in the 
teaching of the subj^ect. Many of them include in their experience 
staff work on curriculum research and development commissions or com- 
mittees. In their approach to the development of instructional materi 
they can be characterized as pragmatic idealists. 



Production 

Another important function in el-hi publishing 
,is production, usually under the direction of ,a production manager, 
who sometimes reports to the editorial director and sometimes to the 
•department head. The production department acts as the liaison and 
the negotiator between the publisher and the suppliers of the many 
different kinds of materials and services that go into the manufac- 
turing of an instructional program: paper; cloth; printing; binding; 
slide, film, phonograph record; and audio tape manufacturing; packag- 
ing, etc. These materials and services are supplied either under con- 
tract or in response to competitive bids. The production department 
also is responsible for working with the editors in designing instruc- 
tional materials, providing necessary art work, finding suitable photo- 
graphs and other illustrations, and' in designing attractive -J)Ook covers, 
and also boxes of various kinds to accommodate the non-book materials 
in the program. J Cover and box design is a special function that may 
seem relatively unimportant ~ but not to the initiated! 
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^ Usually (especially in the larger houses) the 

editorial department includes a copy-editing staff. Copy-editors are 
responsible for preparing the manuscripts for the^ printer. They 
make certain the punctuation is uniform and the spelling is correct, 
and tnark^the pages for type. They also check the statistical data 
and make certain the tables are correct. If they discover passages 
that seem too difficult for the reader, they refer them to the edi- 
tors for revision. 

As this description indicates, the development 
of instructional materials requires the specialized efforts of a 
large number of highly qualified technicians who often combine in 
one person editorial and teaching experience. 

Marketing 

Each publishing division also includes a mar- 
keting staff headed by a marketing director. Since marketing and 
development are closely related, the editorial and marketing direc- 
lk>rs work together in overall planning and in decision-making. The 
marketing director may have a national sales manager who reports 
to him, along with a manager for advertising and promotion. Also, 
the marketing director will of course have the major responsibility 
for dissemination and implementation. 



Consultants 

He usually \}as on his staff a team of consultants 
and a team of product managers. Both consultants and product managers 
play an important role in dissemination and curriculum implementation. 
The consultants, who also have < a teaching and supervisory background, 
perform at least three important functions in the educational publish- 
ing process: they act as consultants to the editors; they interpret 
the instructional materials (especially the underlying learning theories) 
to selection and adoptidn committees; they help to implement the use of 
the materials by ho Id ing\ workshops, classroom demonstrations, and semi- 
nars for teachers using t^hem. 

Not only do the consultants implement the use of 
the instructional materials through their seminars and demonstrations, 
but they also have the benefit of the teacher's evaluation of the instruc- 
tional materials they use. With' the feedback from teachers combined 
with their own experience, their contribution to editorial development 
is invaluable. 
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The contribution of the consultants to the 
Implementation of the curriculum is a part of the service the 
publisher provides 16 the districts without cost, except as re- 
flected in the prices of the materials being sold. Because of 
their contribution and their success in the implementation of 
the curriculum materials, the boards of education and administra- 
•tion of many states and districts make the provision of consult- 
ants a part of the adoption agreement. 



Product Managers 

In educational publishing, the product manager 
is a relatively recent^ addition to the marketing staff. The role 
of the product manager is tb interpret the educational materials 
to the salesmen and to make the presentations to selecting and 
adopting committees. In addition to his role in marketing and 
implementation, he also interprets the trends, especially those 
from the field, to the subject-matter editors. Product managers, 
like editors-in-chief, concentrate th-»tr efforts in their field 
of specialization- For example, there are product managers for 
social studies materials, for science instructional materials and 
for other subject-matter areas. 

The need for product managers reflects the 
transformation in educational publishing from single basic text- 
books to multi-media programs involving new learning theories. 
To grasp the learning theories in an instructional materials 
curriculum program, to understand the inter-relationship of the 
cortponents in a program, and to interpret those theories and inter- 
relationships to the marketing staff and teachers, requires the 
efforts of a specialist who combines in one person the knowledge 
of a curriculum specialist and the ability to interpret that know- 
ledge to salesmen and teachers. 



Sales Managers 

As we have mentioned, the marketing director 
usually includes on his staff a national sales manager. For each 
region there is usually a regional sales manager who reports to 
the national sales manager. The regions usually include the 
Pacific Coast, the Middle West, the Southwest^ the Southeast, and 
the Northeast. Each region includes a sales staff that reports to 
the regional sales manager. The field staff In the region is res- 
ponsible for the dissemination of their company's instructional 

148 

149 



- 11 - 



materials to school administrators, supervisors, department chairmen 
in the secondary school, and to teachers - 



Sales Representatives 

Therfield sales representatives of almost all 
publishers of curricula materials make sales calls on teachers, 
supeirvisors, and administrators at least once or twice each year 
(sometimes more often) in the districts that enroll 90% of the 
student^ • During these interviews they make a presentation of the . 
learning and teaching features of the instructional materials they 
represent in the areas where materials are being selected and adopted 
that year in a particular state or district. Not only, however, do 
the field representatives keep the educators informed about curricula 
trends and instructional materials to implement them, but they also 
learn about educational trends as reflected in =their conversation 
with teachers. They also receive the teachers* evaluations of the 
materials they are using combined with the report of teachers on new 
curriculum materials they would like to have developed for them. 

These reports they submit to their sales managers, 
who collat^ them as guides for the editorial staff and marketing direc- 
tor. For the educational publishers the sales staff combined with con- 
sultants pr6,vides a daily nationwide feedback of the grassroots evalua- 
tion of instructional materials in use and of instructional materials 
heeds. They ^orm a communications bridge between the educational com- 
munity and the publishers. Thus, the sales staff and the consulltants 
provide an important input in the publishing decision process. } This 
input, combined with scholarly research in a discipline or the {funda- 
mental research in the learning process, is the thread that foi|ms the 
pattern of instructional materials development. 



Plans and Projections 

The process for the development of instructional 
materials in many firms begins with short-range and long-range- planning. 
In many el-hi publishing companies the planning takes the form of a 
five-year and ten-year projection. This projection includes an annual 
schedule for the launching of new and revised instructional materials 
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programs, such as elementary science or secondary literature, and in- 
structional-materials for single subjects, such as high school biology. 
For example, the year 1976 for a company might mark the launching of a 
new program and-^ the revision of several already in production- 

The plan would also indicate the publishing sche- 
dule with the copyright dates of a new and revised program. The de- 
cision, however, as to the time required to bring the,: revision or 'the 
new program 'from idea to printed page is based on the conventional 
wisdom that a thorough revision requiring new plates will take at 
least three years and ;a new program will require at lea^t five years 
from the signing of the contract until the program is completed and 
is ready for dissemination to the classrooms. Since these time per- 
iods represent the averages, many programs may require a longer per- 
iod than the schedule calls for, and others less. A program that re- 
quires a longer period than scheduled, however, may jeopardize sales 
becausie the publishing dates are correlated with adoption dates, at 
which time teachers and administrators have the opportunity to select 
and adopt prd^rams with a new approach. 

Some of the adoption dates are determined by 
state and city '"regulations . Also, when the selecting and adopting 
committees are in the process of changing their curriculum from a 
traditional to a modern approach, a company that publishes a modern 
program, regardless of its merits, may lose out because the program 
is published after the districts have adopted programs with the new 
approach. For the instructional materials publisher, the importance 
of timing is difficult to over estimate. 

^ In planning the publisher also makes a tentative 

estimate of the editorial staff required to deyelop the programs during 
each year of the plan. Since the plan may call for growth, it will in- 
dicate the additional staff the manager will need to recruit and train. 

To keep the plans up to date, they are usually 
reviewed and revised annually. Although the plans need 'to be kept 
flexible if they are to take advantage of educational trends and 
publishing opportunities, they do provide the publisher's staff with 
development guidelines. For one thing, they indicate the revenue 
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that is likely, to be available for the development of new and revised 
programs. Another advantage is that they focus the efforts of the 
staff on the programs included in the development plan. And a third, 
and perhaps most important advantage, is the lead time they give the 
staff, especially the editors, to thoroughly research the curriculum 
studies, the learning theories, and the programs currently available 
and the trends in the fields of their specialization, and to be on the 
lookout for authors. From this research, the editors have a better 
opportunity to visualize what the curriculum trends may be five or ten 
years from the present, rather than rest their decisions on the cur- 
rent state of the art.' To'paraphrase John Maynard Keynes, the editor- 
has the opportunity to study the. present in the light of the past for 
the purposes of the future. 

The preparation of a plan, it should be pointed 
out, offers many a special advantage because it involves the entire 
staff, including the consultants and the field staff, which may num- 
ber more than a hundred salesmen. Because the sales staff, including 
the consultants, are involved in the planning, they become more alert 
about id-entifying prospective authors and outside consultants, and in 
identifying school districts where field testing would be welcomed 
by the administrators and teachers. Planning is a part of the pro- 
cess involved in developing curricula instructional materials. It 
provides the background for a description of the steps involved in 
the process of developing instructional materials from planning to 
production. To. this process we turn next. 



From Planning to Production 

Up to this point, we have included a generalized 
description of the transformation of educational publishing from text- 
book publishers to Centers for MuLti-Media Curriculum Development; a 
generalized description of the structure of educational publishing 
firms (especially as the structure relates to development and imple- 
mentation), and a description of five and ten-year planning. We now 
turn our attention to the specifit development of a program from 
planning to production, with some reference to implementation. 

As we have already indicated, a five and ten-year 
plan provides some guidelines for decision making provided, of course, 
the revenue and profitability forecast lives up to expectations. 
Regardless of long-term plans, publishers are always faced with de- 
cisions as to how best to use their staff and allocate their re- 
sources. If a publisher has over a considerable period of time built 
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up an experienced staff in several subject-matter areas, then manage- 
ment is more lilcely to allocate resources and to use the staff to 
revise programs already in production and widely disseminated and to 
develop new programs in the same fields. 

Whether or not a publisher publishes in a limited 
or in an extensive number of fields, management always must decide 
how to allocate funds and utilize staff to best advantage. For the 
purposes of this topic, we r;hall assume that the management has made 
a decision to develop a new program either for the elementary or se- 
condary schools, since the stages for both follow similar paths. 

During the decision-making stage, the first re- 
commendation to publish a new series may originate at several sources, 
either outside or inside the firm. It is very likely to originate 
with the editor--in-chief of a subj ect-matter area, such as science or 
mathematics, and his associates after they have conferred with the 
marketing "Hirector and his staff. The recommendations may originate 
with the marketing director and his staff who take it to the editor- 
in-chief for exploration. Since the reasons that prompt the decisions 
reflect each publisher's special need or opportunity, they do not lend 
themselves to simplistic generalization. It is always true, of course, 
that publishers allocate their funds and assign their staff to those 
programs which in their opinion will enable them to compete successfully 
in the instructional materials marketplace. 

They may be guided in their decisions by a desire 
to develop materials that will compete with programs developed by re- 
search and development study groups or councils. These programs, per- 
haps more tNan any other single factor, have influenced the develop- 
ment decisions of instructional materials publishers. The feedback 
from the sales staff also provides the basis for a publishing decision. 

If an outstanding specialist in a subject-matter 
field approaches the publisher as a prospective author with innovative 
ideas for a new series in an elementary or secondary subject, such as 
mathematics, or for a one-semester or two— semester course, such as 
United States history, the . publisher may decide to accept the proposal. 
Thus, the proposals of prospective authors influence the decisions el-hi 
publishers make. 
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If an editor with a firm develops a curriculum 
pWposal with ini^ovative features that will meet instructional ma- 
terials needs and tirends,' or perhaps foresee trends, his ideas may 
be the main basis for a publishing decision* 

With their marketing and editorial staff, edu- 
cational publishers are also continuously engaged in market re- 
search. This market research supplements the curriculum research 
and development by both study groups and by the publishers' curriculum 
centers and editorial departments. 

Once the management has -approved the develop- 
ment of a new program, the development may take place, in the fol- 
lowing stages. 

In stage one of the editorial process the 
editor-in-chief and his associates decide (whether the instruc- 
tional materials program is a series of a one-year subject) to 
build an informal criteria^ for the program, whether it is for a 
series for several grades or a one or two-semester course. 

In stage two, or in stage one, because these 
stages are interchangeable, the editor and his associates decide 
on the type of authorship they want for the series. 

It is more or less typical for a series to in- 
clude one or more general editors outside the firm, a staff of authors 
(frequently one or more author s^^or each grade or subject), and a 
staff of outside consultants. In .^11 cases, the general editors are 
distinguished for their research in the field both in methods and in 
content. As a rule, they hold positions in distinguished universities 
as professors of education, or chairmen o^ departments of education of 
the subject for which they are\chosen. Since general editors will 
also assist in selecting the aut\hors and outside consultants and in 
directing their efforts, their management experience and acquaintance- 
ship with teachers who have authorXpossibilities are qualifications 
the pblishers also seek. 
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Once the publisher has recruited one or more 
general editors and reached an agreement with them, the next step 
usually is a planning conference between the publisher's editors 
and the general editors for the series. At this conference, they will 
develop a tentative scope and sequence chart, and perhaps identify 
the major concepts to be developed. In the publishing of a series, 
the development of a scope and sequence chart, including the spiral 
development of concepts, is perhaps the most important single undertaking. 
It may be the hinge upon which the series swings. At this stage, 
the scope and sequence chart also helps the series planning group to 
identify the authors they hope to recruit to write the manuscripts 
and develop the components. 

In the authorship the editors try to identify 
prospective authors who contBtlfe in one person or in more than one 
these qualifications: classroom experience, teacher education ex- 
perience, knowledge in depth of the subject matter, of leraning 
theories, and of research studies. 

As outside consultants, the publisher's staff 
and the general editors try to identify both classroom teachers and 
specialists in methods and in the subject matter to assist in planning, 
in reviewing the materials as they are developed and, if they are 
classroom teachers, perhaps in trying out some of the materials in 
their classrooms. A secondary consideration in the selection of 
authors and consultants is geography. Since instructional materials 
are published for a nationwide market, a nationwide authorship is a 
consideration in the selection of authors and consultants. The over- 
riding consideration, however, is the author's ability to produce 
materials of excellence. 

If the movement for learner verification continues 
,to grow, no doubt publishers will also identify teachers who will as- 
sist in the development of the materials by using them in their class- 
rooms under the standards required for learner verification. Since 
several publishers are already supplying data on the learner verifi- 
cation of programs they have developed and produced, this trend in 
el-hi publishing seems already to be well under way. 

At this conference between the publisher's staff 
and the general editors, the participants are also likely to develop 
a tentative list of multi-media components for the program and identify 
teachers or producers to develop both the scripts and the specifications 
for them. 
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At the next stage the editor-in-chief of the pro- 
ject will probably undertake two steps at the same time: he will in- 
vite the authors and consultants to participate in the proj^t, and 
he will begin to develop the specifications for an estimate of costs. 
With the invitation to authors, he may suggest to them that they 
prepare a sample chapter as a prerequisite to a contract. For both 
author and publisher, this exercise has advantages. For the publisher, 
the sample chapter indicates the author's ability to prepare material 
for publication- For the prospective author, the chapter reveals 
to him the preparation time the chapter involves and dlso something 
about his capability to undertake the task. 

During this stage or before, the editorial staff 
for the program will develop the specifications for the production 
managers to use in estimating costs. These specifications will in- 
clude trim size, number of pages for each pupil's book and teacher's 
editions, the number and type of illustrations, and the use of color. 
The editor-in-chief and his associates will also develop specifica- 
tions for the components. These' specif ications will also provide 
printing estimates for printed materials and production estimates 
for non-print components. 

At .the same time, and in conjunction with the 
marketing director, the editor-in-chief and associates will develop 
a one-year and a five-year forecast of sales of each component. On 
the basis of production estimates and forecase, the management can 
determine a unit price to cover amortization costs, author's royalties, 
printing and binding costs, and operating costs, with a gross profit, 
compatible With the firm's policy. 

With these specifications the production manager 
of the program will secure comparative costs for the printed materials 
from printers and binders and comparative costs for non-print com- 
ponents from the producers of these materials. 

If the per-pupil cost of the materials does not 
fall within the limits of school budgets or is excessively out of 
line with the cost of comparable competing programs, the management 
will request the editor-in-chief to reduce his costs without saag:;L- 
f icing his major goals. Often this can be accomplished. '^"^ 
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This simplistic description of the business 
arithmetic required in planning a program, whether a series or 
a program for a one-year subject, such as United States history, 
obviously cannot include every detail. It does, however, make the 
point that instructional materials programs are carefully budgeted 
at the time they are launched, and the costs regularly reviewed, 
throughout the period of development. 



A Special Note about Costs 

The, costs discussed here include only those that 
usually come under the heading, in publishers' accounting systems, 
of "cost of goods sold" — "plate" or "plant" costs (non-recurring 
pre-publication costs); production or manufacturing costs (the 
creation of saleable inventory); and royalties. They do not, however, 
normally include staff salaries and other overhead (rent, light, 
heat, etc.). 

"Plate" or "plant" costs are non-recurring, 
pre-publication development costs. They generally include every- 
thing that is paid to people outside the firm to create the printing 
plates, master tapes and films, dies, etc., that are needed to manu- 
facture multiple copies of all the program's components. Sometimes 
the initial manufacturing runs to create inventory (since this in- 
ventory is often used mostly for examination copies) are included in 
plant costs, but more often they are not. The various plant-cost 
items mentioned* above, which obviously vary greatly from ^project to 
project (and from accounting system to accounting system!), are com- 
parable to the machine tools of industrial manufacturing. The cost 
of these it^^ms is the seed money that must be amor, tized within a rea- 
sonable period (usually from two to five years) in the pricing and 
sale of a program if it is to be financially successful. 

Most educational publishers experiment from 
time to time with the allocation of all costs (including editorial, 
production, and administrative salaries, and a share of overhead) 
to plant costs, but most such experiments lead eventually to frustra- 
tion. The procedures that must be set up are complex and time-consum- 
ing, and the results usually are distorted, because of disagreements 
about proper allocation, and simply because most editors and production 
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people find it hard to" fill out time cards'. Nevertheless, publishers 
quite properly persist in attempting to set up realistic cost accounting 
systems for major projects. 

The above analysis indicates why it is often dif- 
ficult for anyone (even the publisher) to say exactly what has been 
spent on the development of a particular program* As a rule of thumb, 
however, it is probably true that for every dollar spent on "plane" 
cosrs^'^nather dollar" l"s""spenl: on' Tn^^ overhead, including es- 

pecially editorial, production, and administrative salaries. That is 
why a publisher may say that a particular elementary reading program 
for grades K-6 cost about $2,500,000 to develop, but, he hastens to 
add, "when you consider all our out-of-pocket expenses before a 
single item was sold, it was probably closer to $5,000,000." 

As to the average total cost of developing a basic, 
multi-component, multi-media instructional materials program, it can 
vary all the way from about $400,000 to $500,000 for high school bio- 
logy up' to $6,000,000 (and even higher) for a per-K to grade 8 elemen- 
tary reading program. These total estimated costs include overhead, 
but not the creation of initial inventory. 

Writing, Rewriting, Artwork, Classroom Testing 

After the full staff of authors and consultants have 
been recruited and the budget approved, the publisher usually brings the 
editorial staff involved in the program, including the general series 
editors, and the authors and perhaps outside consultants, together for a 
working conference. At this conference authors and editors review and 
revise the scope and sequence and develop the uaderlying teaching and 
learning ideas for them. 

liere the editor and his staff will set the targets 
for the development of the manuscript, including the teachers' editions. 
As the first target, the editor is likely to set the completion of the 
first chapter. As he receives these chapters, he sends duplicates to 
the general editors and to the outside consultants. By setting— the —--^ 
manuscript for chapter one as a target, the editor gains an insight into 
the work habits and general competency of the authors. If the reviews of 
the general editors and of the consultants indicate a chapter requires 
revision, it is better to return a single chapter for revision than a 
complete manuscript. 
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With the first chapter in hand, the design depart- 
ment can begin to develop art work and collect illustrations. Also, 
the production manager caij estimate length. Thus, the author has a 
. guideline to follow in writing the remaining chapters of the program. 

Each chapter of each book may be written, re- 
vised and rewritten as many as three or more times before it is 

ready_ f^r the, co^^^^ .During, this .time, the.a'uthors have had . 

the opporti^ity to review and recommend revisions of all art work, 
and. teachers and outside consultants may have tried out parts of 
the manuscript with their own pupils, if not with all the pupils in 
their school or district. The outcome of the classroom use of the 
materials the teachers include in their reviews., 

.Although there are many factors that create the 
need foj writings revision, and rewriting, the identification of con- 
cepts and explanation of concepts at their .point of introduction and 
their spiral development from grade to grade are overriding factors. 
The scope and sequence charts that"" the authors nnd editors prepare al- 
/ most always includes the ccacepts emphasized at each grade level. 

For a series of a single program to have the bene- 
fit of the development along the lines as described in this report usu- 
ally requires a minimum period of five years from p-lahning to production. 
However, a crash program may reduce the period by a year or two. 

The Challenge of Implementation 

With the advent of multi-meriTp instructional materials 
programs reflecting new learning theories and the best of moderp[ scholar- 
ship, publishers are faced with new implementation challenges In a 
sense, the implementation of their new curriculum materials ^requires 
the recycling of teachers Reaching the new program, including the edu- 
cation of the teacher in some of the content of the subjeor, A new 
^ social studies program with its interdisciplinary approacri, for exam^ple, 
may draw a considerable amount of its content from disciplines not in- 
cluded in the teacher's undergraduate and graduate program of studies. 
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; The muiti^media pi^ogram" also" makes new "deinands 

on the teacher for the storage, retrieval, and distribution of the 
materials, especially if these are adapted for individualized in- 
struction, and for the use of media th^t may be unfamiliar. It is _ 
still true, for example, \that most teachers are all thumbs in operating 
a fil'nstrip or movie projector. 

To these challenges of implementation, if the 
materials are to be used to their best \advant:age, the publishers 
are responding in a variety of ways including these: 

They are, for example, not only developing teachers' 

editions to accompany the textbook, jbut they are also 

developing teachers' guides for each of the components. 

These editions and guides are-*a necessary and important ^ 

part of the publisher's implementation of the curriculum. 

They also make available to the instructional staff in 
districts adopting the program the services of consultants. , 
These consultants may be either attached to the publisher's 
staff or teachers who have had experience in teaching the 
program as it was developed. ' The authors of the programs 
are often available as implementation consultants. 

Summer institutes sponsored by the publisher rriay ,also be 
a part of implementation efforts for certain programs. 

Some publishers also develop implementation bulletins that 
they send out periodically to the teachers who request them. 

Although these efforts are in the right direction, 
they may not be equal to the challenge of new curriculum materials with 
their new approaches to teaching and learning and with content fre- 
quently not included in the teacher's undergraduate and graduate cur- 
riculum. The publisher's efforts to expand implementation beyond their 
present efforts is limited by the money available in school budgets. 
Many publishers are convinced that the programs they develop with a 
heavy investment of their own funds, as well as the programs developed 
by Study Groups and Councils, do not always live up to expectations be- 
^ cause of the cost limit imposed on implementation. 
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The Impact of Federally- Funded Curricultim Projects 

As noted. on page four and elsewhere in this report, 
federally- funded curriculum projects (along with a number of associa- 
tion-funded and foundation-funded efforts) have been one of the par- 
ticularly significant change agents in el~hi pbblishing since the late 
i950's. Although BCMA Associates cannot, of course, act as definitive 
• spokesman for the industry -in-commenting on this complex .topic we . 
nevertheless offer in this , section of our report some observations, 
based on a wide range of personal Experience, on the impact thes^ cur^- 
ricu^um projects have had on el-hi publishers - 

Since el-hJ- publishers are by nature highly in- 
dividualistic, highly competitive, and free-enterprise-oriented, many 
of them expressed concern, when the federally-funded projects were first 
announced, about the role of the federal government in subsidizing the 
t development of instructional materials. Many believed that it would be 
more appropriate to spend equivalent funds on educating teachers to 
bring', them up to date oh new methods and recent scholarship, rather 
than on the development of textbooks and related materials. Others 
thought, that materials created with taxpayers' money should be in the 
public domain, not copyrighted and licensed to a single commercial pub- 
lisher, but made available to all as models. Others were genuinely 
skeptical about how much innovation school authorities, with their- limited 
budgets for instructional- materials, would buy. 

Many el-hi publishers were also concerned about the 
development of programs that would not have the input of the publishers' 
professional editorial atid production staffs. As responsible publishers, 
they were convinced the projects would benefit from their editorial and 
production experience as well as from their marketing capabil^Lty. 

Publishers, too, did not want to be placed at a dis- 
advantage because they had to compete against programis where the develop- 
ment costs included not only field-testing in many c las sr boms but also 
teacher education programs that prepared teachers to understand concepts 
new to them and in addition created a built-in market for the curriculum 
materials when they were published. 
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At the same time, however, all thoughtful and 
responsible el-hi publishers were aware that many aspects^of the 
curriculum, at all levels and in all subject areas, were in need 
of change and improvement, and that as commercial publishers they 
simply did not have the financial resources nor the curricular 
clout to accomplish some of these needed innovative changes. (The 
annals of el-hi publishing are studded with forward-looking text- 
books and programs that were ahead of their time and yet were 
failures in the marketplace.) 

Though many publishers may haiie had serious mis- 
givings about the role of the federal government in funding curri- 
culum research and development projects, they were also aware that 
basic research and development for the improvement i of education 
lagged behind research and development in health, medicine, agricul- 
ture, industry and other areas. For publishers as well as pro- 
fessional educators, there were many questions bbout learning and 
curriculum development that educational research and development 
could answer. This point of view seems to us as prevalent today as 
it was in the fifties. 

Responsible and thoughtful el-hi publishers . 
also realized that organizations like the National Science Founda- 
tion were making a serious effort to bring about desirable changes 
in the curriculum through the creation of new kinds of textbooks and 
other materials because they believed that change would come about 
•most quickly in this way. 

This point of view Dr. Keit,h Kelson voiced in a 
conversation several years ago with' an educational publisher, when 
the publisher asked him why the National Science^ Foundation had turned 
to the development of instructional materials in science and mathemati 
to implement the National Defense Education Act. He replied that, 
in response to the mandate from Congress to strengthen the teaching 
of science and mathematics, the NSF decided that the quickest and 
most effective way to bring about a nationwide transformation was to 
develop instructional materials that included the new research 

combined with a\eacher education program correlated with them. 

\ 
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Furthermore, when the editors, as part. of their 
jobs, became acquainted with the curriculum projects as they were 
being developed, and when some of their aathors (and potential. authors) 
became deeply involved in many of them, the publishers began to realize 
the impact the programs would have on education • As they became better 
acquainted with the programs, it was clear that they would have to pay 
attention to them and, despite some continuing misgivings and reserva-^ 
tions, they did. All thoughtful and responsible el-hi publishers, 
without exception, eventually began to view curriculum projects as 
essentially another kind of author — gigantic and overwhelming in 
some instances, but an author nevertheless. 

They all came to a position something like this: 
"We may not wholly approve of some of the procedures in developing 
materials, and' we might develop them differently if we were respon- 
sible for them; nevertheless, if we think we are capable of publish- 
ing them successfully and profitably, there is no reason why we should 
not respond to the invitations to submit proposals to publish them." 

As a rule, the invitations issued by the study 
' groups' included a conference where spokesmen for the study group 
would brief the publishers on the projects, explain the procedure 
for submitting proposals, and answer questions the publishers might 
raise. These invitations issued by the study groups were forwarded 
to all el-hi publishers and they were all given equal ^opportunity to 
submit proposals. 

Virtually all the first-line publishers eventually 
responded to the invitations, and many of them were successful bidders. 
More than half of the companies listed on page three have published 
one or more curriculum projects developed by'a curriculum center or 
study group, including those funded by the National Science Foundation. 

By the -early -I960' s it also was becoming clear 
that one of the major aims of federally-funded curriculum research 
and development projects to stimulate the creation of competitive. 
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commercially-funded innovative instructional materials, was beginning 
to be realized. At one publisher's meeting in those days, the McGraw- 
Hill representative said to the Harcourt representative: "We couldn|t 
have published some of the things we're publishing now if you hadn't 
published A-LM (i.e., the USDE-funded "Glastonbury project" in modern 
foreign languages) . 

It was clear that other instructional materials 
developed by publishers were beginning to reflect many of the new 
approaches, and were selling better as a result I 

The development of instructional materials' in 
mathematics by federal funds and private funds also indicates the 
influence of the curriculum studies in encouraging publishers to 
publish materials with the new approach. 

As early as 1962 there were as many as sixteen 
algebra series reflecting in their titles a modern mathematics 
approach. 

For the teaching of modern mathematics in the 
elementary schools, new textbooks were published in rapid succession, 
including those developed by commercial publishers, as well as others 
developed by study groups and curriculum centers. In fact, one of 
the most successful programs in winning adoptions was developed 'and . 
published by a comiTiercial publisher. 

With instructional materials available to them for 
the teaching of modern math, modern science, and modern foreign lang- 
uages, educators rapidly adopted the new curriculum materials. For 
example, within a short period of time after the new math was made 
available, it is estimated that 85 percent of the nation's schools had 
adopted the new math in some form or other. 

Although recently-published curriculum materials 
combine some of the old math with the new, especially in computation, 
the new math has led to permanent changes in school curricula. And the 
new math received its major impetus from the mathematics curriculum 
development centers including the School Mathematics Study Group (SMSG) 
funded by the National Science Foundation 
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One of the doubts initially held by many el-hi 
publishers was that teachers would not have the capability of using 
effectively the new curriculum materials developed by curriculum 
centers without the benefit of special training. The fact that some 
of the projects, particularly the NSF projects and the "Glastonbury 
project" that led to A-LM, planned to provide this training in summer 
institutes and workshops, was a big "plus" factor in the minds of 
el-hi publishers, who simply could not provide the necessary teacher 
recycling with their own fUnds and the consultants on their s'taff . 

In reviewing today the developments in the 
industry, el-hi publishers are likely to take a different point of 
view about federally- funded curriculum projects from the point of 
view they held less^ than two decades agQi For one thing, educational 
publishing continues to be very much alive, and even thriving. For 
another, the industry has transformed itself from publishers of text- 
books to publishers of programs composed of many components. Today, 
publishers generally tend to be interested in publishing i)rograms of 
excellence wherever they are developed. It can be said with some 
confidence, we believe, that any curriculum project that lieets the 
demands of the educational marketplace is likely to find a\ publisher. 

To this we add our personal opinion that the 
earlier a developer of a curriculum project can reach an agreement 
with a publisher, the better it will be for both parties and for the 
program. 

The impact of the federally-funded curriculum pro- 
jects perhaps can be best summer up in the words of a typical publisher, 
"They certainly have shaken up the ^ industry and education and made us 
think." 

The most Convincing evidence, however, that these 
curriculum projects have been, good for publishing is, of course, the 
long list of commercially-published programs now available that grew 
out of them, including the early projects developed by PSCS and BSCS. 
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Although the list of innovative instructional 
materials programs funded by the National Science Foundation and 
other governmental and non-governmental agencies currently in us a 
in the schools is impressive, perhaps the larger contribution the 
programs have madetto the improvement of education is their impa'ct 
on the development of instructional materials by commercial publishers 
For example, in the description of a well-known elementary science 
program, the publisher makes this comment: "Tllis program takes 
advantage of the research and teacher experience gained from the 
federally-financed science, curriculum development projects of the 
1960's." Another publisher gives credit to federally-funded science 
projects with this comment: " Investj-gations in Science is a grade 
1-6 textbook series published in 1972 which incorporates major 
features of several of the federally-financed science curriculum 
development projects." 

Although the instructional materials developed by 
curriculum study centers and by commercial publishers are influenced 
by the same trends in education and American society, the commercial 
publisher has had the opportunity to benefit from the emphasis the 
curriculum programs have given to the improvement of education in 
many areas, ,including these: 

1. In cognitive learning, especially in identifying and developing 
concepts . 

2. In tUej^e of Inquiry and discovery in learning. 

3. In the preparation of "a series based on sequential .and cumulative 
learning, especially in social studies. 

4. In the use of diversified materials for which curriculum study 
programs may have served as models. 

5. In developing individualized programs for the teaching of math 
and reading and other sul^jects. 

6. In the development of materials that involve .the student in the 
thought processes of the specialists in the discipline. 

7. In the preparation of bilingual programs of insturction. 
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8. In closing the gap between the current research in a discipline 
and the content of the instructional materials used in the 
classroom. 

9. using field- testing as a technique for improvement. 

To summarize, the f ederoHy-f^nded research and 
development that was launched in 1958 with many misgivings on the part 
of many educational publishers has now become an integral part of the 
el-hi publishing process. 
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Currlcutum 
Project 



Grantee 



Develop* implemen- 
ment tation 



Publisher 



Dale of V 

Publish- /'/ 

ing '/ 

Agree- Royalty E)(clusive 

ment Rale ./Period 



Comments 



PSSC 



EDC 
(MIT) 
G-13087 

G-3100, G-13912 
G-18846. G-18854 
G-21793, G-22130 
GE-2566. GE-1995 
GE-3846, GE-4496 

Stanford 
(Yale) 
G- 18758 
G-5422, G-6308 
G-16904, G-17624 

Earlham College 
(Wesleyan & Reed) 
G-11217 
G-6493. G-5456 
G-9158 

U. of Colorado 
(AIBS) 
G-7220 
GE-1321 



U, California- 
Berkeley 
(Ohio St.) 
G- 12226 

G-11090, G-7656 

U. of California— 

Berkeley 

G^13879 

Q-9153, G-18845 

(j. of Illinois 
;G-13906 



$5.3M 



$6.8M D.C. Heath 
Company 



1959 



12% /No limit 



SMSQ 



CBA 



J&S 



CHEM 
Study 



Elementary 
School 
Science 
Project 

Elementary 

School 

Science 

Project 

(ESSP) 



TV Program Minnesota 

for Mathe- Academy of 

matics Sciences 

Teschers G-13885 

Syracuse Webster 

Webster College 

Mathematics G-1914a 
Project 

(Madison Math) 



Elementary 
Science 
Study (ESS) 



EDC 
G-21815 



$14.4M $2.26M None 



$1.2M $2.3M McGraw-Hill 
(Webster Div.) 



$10.4M $9.4M Houghton Mifflin 
(Blue) Rand 
McNally (Green) 
Harcourt Brace 
(Yellow) 

$2.6M $4.6M None 



$7M $6K None 



$.6M $6K Harper & Row 



S.2M SO 



$1.1M $2.5M 



$7.6M $4.1M McGraw-Hill 
(Webster Div.) 



International Edition 
Published by D.C. Heath 
4/17/67, 12% royalty till 
12/31/70, 9% thereafter 



Random House (Singer) had an 
exclusive distribution 
arrangement ($.05/copy). 
Yale University Press sold 
trial editions at cost 



1962 



1964 

1963 
1963 



10-12% No limit a sliding,coyattfscaie^ of 
— tO<!^'Tor 50,000 copies and 
12% thereafter 



20% No limit 

20% 
20% 



1968 



6% 8 years 



1969 



Anthropology American 
Curriculum Anthropological 
Study Association 
Project (ACSP)G-22323 



$1.4M $.7M TheMacMillan 1966 
Company 



7% 4'/? years 



12V;% None 



2nd Edition— 8% royalty 
Free use after 6/30/73 



W.H. Freeman distributed 
hard cover version. Revisions 
published by D.C. Heath Houghton- 
Mifflin & Prentice Hall at no 
royalties but for $35 K each. 

No commercial publisher- 
materials sold at cost 



6 books 



Houghton Mifflin distributed 
films (11/71) at a sliding 
royalty rate of '/^%-2% depending 
on footage. Free use after 
12/31/79. 

Publisher not obligated to pay 
royalty after free use 



rtoyalty rate was reduced 50% 
if sales were less than 500 
copies the first year 
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Curriculum 
Project 



Grantee 



Develop- Implemen- \ 
ment tation Publisher 



Date of 
Publish- 
ing 
Agree- 
ment 



Royalty Exclusive 
Rate Period 



Comments 



Science — A 


AAAS 


$2.3M 


$4.9M 


Xerox (Ginn) 


1967 


6% 


7'/i years 


Royalty based on gross receipts. 


Process 


G-22286 














Revision also published with 


Approach 
















sliding scale (vSi%-3%) 


<SAPA) 
















Univ. of 


U. Illinois 


$4.9M 


$5.8M 


the^MacMillan 


1968 


8% 


6 years 




Illinois 


G-23554 






Co.— Vector 








Commitee 








Geometry 










on School 








Harper & Row 


1968 


3% 


7'/j years 


Rate justified by difficulty 


Mathematics 








7th & 8th 








in selling material 


(UlCSM) 








Grades 








MINNE- 


U. of Minn. 


$5.0M 


$.7M 


W.B. Saunders 


1969 


15-17% 


4'/i years 


\ Sliding scale: 15% (10K copies). 


MAST 


GE-3 












'1*6% (it)^20K)' and 17% (">20K). 


















Edu. Tech. also given 5 years 


















exclusive for distribution of 


















some material (7/27/73) for $3000. 


Science 


U. of California— 


$4.3M 


$6.7M 


Rand McNally 


1970 


4-6% 


2 years 


D.C. Heath was the initial 


Curriculum 


GE-2914 












publisher at a 5% rate. Rand 


Improvement 


(U. Maryland) 














McNally's rates were 6% for the . 


Study (SCIS) 


GE-600 














guides and 4% (up to 200,000 


















copies of the student manual) 


• 
















and 6% the.''eafter. 


Earth 


American 


$3.5M 


$.7M 


Houghton Mifflin 


1967 


8% 


5'/^ years 


Films also distributed 


Science 


Geological 














Curriculum 


Institute 
















Project 


GE-1426 
















<ESCP) 
















- 


School 


U. of III. 


$.97M 


0 


— 


— 


— • 


— • 


No commercial distribution 


Science 


GE-1816 
















Curriculum 


















Project 


















MACOS 


EDC 


$4.8M 


$2.2M 


CDA 


1970 


3% 


5^^ years 


Film royalties included rates 




GE-3430 














of 2'/i%, 5%, 15% and 20%. 




GE-1831. GE-2567 
















Elementary 


Utah 


$.1M 


0 


— 


— 


— 


— 


No commercial distribution 


School 


oiaie 
















Science 


GE-1376 
















Improvement 


















Project 


















Secondary 


Rugters 


$r2M 


$.'65M 


McGraw-Hill 


1966 


8% 


No limit 


Princeton & Rutgers split 


School 


GW-2272 






(Webster) 








royalties on a 75%-25% basis 


Science 


(Princeton) 
















Project 


GE-2272 
















Introductory 


EDC 


$1.4M 


$5.0M 


Prentice Hall 


1965 


10% 


No limit 


Publisher distributed prelimi- 


Physical 


GE-2510 














nary text in paperbaci( 


Science 


















(IPS & PSIl) 


















Films for 


National 


$.28M 


0 










United World Films, Inc. distrib- 


In-Service 


Council of 














uted films on a 5 year exclusive 


Education 


Teachers of 














basis for a 12^^% royalty on 


of Teachers 


Mathematics 














gross rentals 


of Elemen- 


QE-2651 
















tary School 


















Mathematics 
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Curriculum 
Project 



Grantee 



Develop- Implemen- 
ment tation 



Publisher 



Date of 
Publish- 
ing 
Agree- 
ment 



Royalty 
Rate 



Exclusive 
Period 



Comments 



Quantitative 
Approach in 
EteiTrentary 
School 
Science 

High School 

Course 

Modern 

Coordinate 

Geometry 

High School 
Geography 
Project 
(HSGP) 



SUNY at 
Stony Brook 
GE-2651 



Wesleyan U. 
GE-4319 



Association 
of American 
Geographers 
QE-5168 



$21K $11K — 



$137K 0 Houghton f^ifflin 1969 



$2.3f^ $1.9f^ The f^acf^hlan 1968 
Company 



No commercial distribution 



5% 8 years 



8% 6 years 



Sociological American 
• Resources Sociological 
for the Association 
Social Gt-5186 
Studies (SRSS) 



Engineering 

Concepts 

Curriculum 

Project 

(ECCP) 



SUNY of Stony 
Brool< GW-7646 
(Commission on 
Engineering Edu. 
Polytechnic Inst, 
of Brooidyn) 
GE-5973. GW-2247 



$2.51^ $1.8r^ 



$2.0r^ $3.0f^ 



Allyn & 
Bacon, Inc. 



f^cGraw-Hill 
(Webster Div.) 



1968 



1971 



fv^acf^illan in 1970 acquired 
exclusive rights for 7 years to 
publish reference volumes at a 
3% royalty (for first 15K copies) 
and 8% thereafter 



8% 6 years Royalty on gross proceeds 



8% 7 years 



Elementary 


EDC 


Mathematics 


GE-7813 


Project 




Harvard 


Harvard U. 


Project 


MOR 65-45 


Physics (PPC)AG-161. 


Course 


MOR 69-13 


Second 


Newton College 


Course in 


of the Sacred 


Physical 


Heart (EDC) 


Science 


GW-2187 


(PS II) 


GW-6719 


Portland 


Portland 


Interdisci- 


State 


plinary 


University 


Science 


GW-4216 


Project 




ISCS 


Fla. State 




GW-4235 



$1.6M $120K 



$0.9M $4.7M Holt, Rinehart & 
Winston. Inc. 



(See 
IPS-EDC) 



$144K $3K 



Prentice Hall 



1970 



10% 5 years 



$1.5M $5 0M General Learning 1972 
Corp. (Silver 
Burdett) 



10-15% 5 years 



Agreement under negotiation 



Supported by OE. NSF funding 
provided by interagency 
transfer 



Original publishing agreement 
of 6/70 between EDC & Prentice- 
Hall assigned to Newton on 
12/70 



Phase I materials supported by 
OE under separatecontract. Same 
publisher and similar royalty rates. 
Sliding scale at 10% for first 
5000 modules and 15% thereafter. 
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Curriculum 
Project 



Grantee 



Develop- Implemen- 
ment tation 



Publisher 



Date of 
Publish- 
ing 

Agree- Royalty 
ment Rate 



Exclusive 
Period 



Comments 



Secondary 
School 
Mathematics 
Curriculum 
Improvement 
Study (SSMCIS) 



Teacher's 
College 
Columbia 
GW-4533 



$.7M 



$.19M 



Columbia 
Teacher's 
College 
Press 



1974 10-12% 10 years 



Computer- U. of Cal. 

Based Self (Berkeley) 

Instructional GW-5061 

Course for 

Supplementary 

Training of 

Secondary 

School 

Teachers 

of Physics 



$139K 



Environ- 
mental 
Studies for 
Urban Youth 
(ES) 

Comparing 
Political / 
Experiences 
(CPE) /' 



Evergreen 

State 

College 

(AGl GW-5387) 

GW-7900 

American 

Political 

Science 

Association 

GW-6810 



Improvement S.W. Education 
Prpject In Development 
Mathematics Lab. GW-3424 
for Subcul' 
tural Groups 



$.9M 



SI.SM 



S.4M 



$.8M 



S57K 



Aiddison 
Wesley 



Biomedical 
Interdisci- 
plinary 
Curriculum 
Project 
(BICP) 



Demonstra- 
tion and 
Experimenta- 
tion in 
Computer 
Training and 
Use in 
Secondary 
Schools 



California 
Committte on 
Regional Medical 
Program GW-6815 
(U. Cal. -Davis 
GW-6801) U. Cal" 
Berkeley GW-3435 

Dartmouth 

College 

GW-2246 



S1.85M S 16M - 



S 33M 



Prontice Hall 



1971 



15% 6 years 



10% rate foi Courses 4 & 5 
12% rate for Course 6 



Evaluation study of adequate 
mode of instruction for 
teachers newly introduced to 
Harvard Project Physics. Materials 
need further improvement 
before publication possible 



Agreement Under negotiation 



Course under development. 
Some materials available 
for trial use. 



Materials not available for 
commercial distribution 



Materials not available for 
commerical distribution 



10% rate on foreign sales 
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Curriculum 
Project 



Grantee 



Develop- Implemen- 
ment tation 



Publisher 



Date of 
Publish- 
ing 

Agree- Royalty Exclusive 
ment Rate Period 



Comments 



Boston B.U, 

University GW-7912 

Mathematics (PES 74-18105- 
Program 



Development SUNY-Stony ^ 
of Computer Brook GW-7647 
(Polytechnic 
Inst, of Brook- 
lyn GW-5883) 



Simulation 
Material 
(Huntington 
M) 



Development State College 
of Teacher of Iowa 
Training • G-24992 
Materials in 
Mathematics 

Experimental Stanford 
Teaching of G-9173 
Mathematics G-18709 
in Elementary 
School 

Exploring EDC 
Human GW-5209 
Nature (EHN) 

First Year Chicago 

Algebra with GW-7915 
Applications 
Project 



Human 
Behavior 
Curriculum 
Project 

Human 

Sciences 

Program 



APA 

GW-7905 



BSCS 
GW-7644 
(U. Colorado) 
GW-6700 



Individual- Florida 

ized Science State 

Instructional GW-7645 
System 

(ISIS) \ 



Mathematics 
Problem 
Solving 
Project 



Indiana 
GW-7911 



Mathematical Oregon 
Resources GW-7810 
Project GW-7910 



$294K 



$.47M $.15M Digital 

Equipment 
Corporation 



$24K 



S2.7M 



Agreement under negotiation 



1974 20% 7 years Royalty rate applies only to 
period of exclusivity. Copy- 
right later assigned to SUNY 



Study guides sold at cost by 
grantee 



Academic Press 1971 10-15% 10 years No royalties on first 2000 

copies, 10% on second 2000 
12% on third and 15% thereafter 



S2,5M S 15M CDA 



$36K 



S.7M 



$1.3M S.5M 



$3 4M $.16M Xerox 
(Ginn) 



S265K 



S292K 



Agreement under negotiation. Trial 
editions sold at cost 



Materials not available 



Materials under preparation 



In testing phase 



1974 8-13% 10 years 8% (0-$l5 million sales) 10% 
($15-30 million) 13% (over $30 
million) 



Materials under preparation 



Dissemination of materials 
by grantee in cooperation with 
Oregon Mathematics Education 
Council 
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Curriculum 
Project 



Grantee 



Outdoor ' 

Biotogy 

Instructional 

Strategies 

(OBiS) 



U. of Cal. 
Berkeley 
GW-6820 
(PES 74-2091 



Project Florida 
for the State 
Mathematical GW-7913 
Development (PES 74-18106) 
of Children 

Technology- SUNY at 
People- Stony Brook 
Environment PES 73-06358 
(TPE) 



Unified 
Science and 
Mathematics 
for Elemen- 
tary Schools 
(USMES) 



EDC 

GW-5207 



Develop- Implemen- 
ment tatlon 



Publisher 



Date of 
Publish- 
ing 
Agree- 
ment 



Royalty 
Rate 



Exclusive 
Period 



Comments 



$.67M 



$.3M 



$.47M $2K 



$134K $163K Learning 
Realities 
Inc. 



S2.6M $1.3M 



Trial materials sold at cost 
Commercial tjistribution plan 
not formulated yet 



Materials under development 



Agreement under negotiation 



Publisher is being selected 
Houghton-Mifflin is publishing 
USMES Conference Project 



SUMfWARY 

Royalty Rates (3-20%) 

Exclusive Periods vary from unlimited— to 2-10 years, restrictions seem to come into existence in 1967. 
Foreign royalties are generally at 50% of the domestic rates. 



Royalty Rates 

3% 

4% 

5% 

6% 

7% 

8% 
10% 
12% 
15% 
20% 



(2) 
(1) 
(1) 
(2) 
(1) 
(7) 
(6) 
(2) 
(2) 
(4) 
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